Context Relevance measures if the context has enough information to answer the user query.

Context relevance

Context Relevance measures if the context has enough information to answer the user query. High Context Relevance values indicate strong confidence that there is enough context to answer the question. Low Context Relevance values are a sign that you need to increase your Top K, modify your retrieval strategy, or use better embeddings.
Context Relevance is differentiated from Context Adherence: Context Relevance evaluates whether the retrieved context is relevant to a user’s query whereas Context Adherence determines how well the response aligns to provided context.

Best practices

Use for Results Assessment

Leverage Context Relevance when assessing the quality of your retrieval system’s results and determining how accurately it adheres to queries.

Combine with Other Metrics

Use context relevance alongside context adherence, correctness, and completeness metrics for a comprehensive view of response quality.