Learn how to create evaluation metrics using LLMs to judge the quality of responses
Type | Allowed return values | Description |
---|---|---|
Boolean | true ,false | A true or false prompt. The prompt must return true or false only. |
Navigate to the Metrics section
Select the LLM-as-a-Judge metric type
Give your metric a name and description
"Compliance - do not recommend any financial actions"
:Configure the metric
Configure the metric prompt
Optional - get help writing a prompt for an LLM span metric
Save your metric