Context Relevance measures if the context has enough information to answer the user query.
Context relevance
Context Relevance measures if the context has enough information to answer the user query. High Context Relevance values indicate strong confidence that there is enough context to answer the question. Low Context Relevance values are a sign that you need to increase your Top K, modify your retrieval strategy, or use better embeddings.Context Relevance is differentiated from Context Adherence: Context Relevance evaluates whether the retrieved context is relevant to a user’s query whereas Context Adherence determines how well the response aligns to provided context.
Best practices
Use for Results Assessment
Leverage Context Relevance when assessing the quality of your retrieval system’s results and determining how accurately it adheres to queries.
Combine with Other Metrics
Use context relevance alongside context adherence, correctness, and completeness metrics for a comprehensive view of response quality.