Advanced RAG 09: Prompt Compression

Method Classification, Algorithm Principles and Code Explanation

The RAG process may encounter two issues:

• Large Language Model(LLM) typically has a context length limit. Therefore, the longer the input text, the more time-consuming and costly the process becomes.

• The retrieved contexts may not always be useful. It’s possible that only a small portion of a larger chunk is relevant to the answer. In some cases, it may b…