A technique used in AI-driven retrieval systems to reduce the amount of data processed by filtering and summarizing relevant information before passing it to a language model. It enhances efficiency by selecting only the most pertinent context, improving response accuracy while minimizing token usage.
The Document Compressor takes a list of documents and shortens it by reducing the contents of documents or dropping documents altogether.
Simple RAG
