Skip to main content
POST
/
v2
/
scorers
/
llm
/
validate
/
log_record
Validate Llm Scorer Log Record
curl --request POST \
  --url https://api.galileo.ai/v2/scorers/llm/validate/log_record \
  --header 'Content-Type: application/json' \
  --header 'Galileo-API-Key: <api-key>' \
  --data '{
  "filters": [
    {
      "case_sensitive": true,
      "name": "input",
      "operator": "eq",
      "type": "text",
      "value": "example input"
    }
  ],
  "log_stream_id": "00000000-0000-0000-0000-000000000000",
  "pagination": {
    "limit": 5,
    "starting_token": 0
  },
  "sort": {
    "ascending": false,
    "name": "updated_at",
    "sort_type": "column"
  }
}'
{
  "metrics_experiment_id": "<string>"
}

Authorizations

​
Galileo-API-Key
string
header
required

Body

application/json

Request to validate a new LLM scorer based on a log record. This is used to create a new experiment with the copied log records to store the metric testing results.

​
query
string
required
​
response
string
required
​
chain_poll_template
object
required

Template for a chainpoll metric prompt, containing all the info necessary to send a chainpoll prompt.

​
scorer_configuration
object
required
​
user_prompt
string
required
​
starting_token
integer
default:0
​
limit
integer
default:100
​
log_stream_id
string<uuid4> | null

Log stream id associated with the traces.

​
experiment_id
string<uuid4> | null

Experiment id associated with the traces.

​
metrics_testing_id
string<uuid4> | null

Metrics testing id associated with the traces.

​
filters
Filters · array
  • LogRecordsIDFilter
  • LogRecordsDateFilter
  • LogRecordsNumberFilter
  • LogRecordsBooleanFilter
  • LogRecordsTextFilter
​
filter_tree
object | null
  • FilterLeaf
  • AndNode
  • OrNode
  • NotNode
​
sort
object
​
truncate_fields
boolean
default:false

Response

Successful Response

Response model for validating a new LLM scorer based on a log record.

Returns the uuid of the experiment created with the copied log records to store the metric testing results.

​
metrics_experiment_id
string<uuid4>
required
⌘I