Skip to main content

Type Alias: ScorerConfig

type ScorerConfig = object;
Defined in: src/types/new-api.types.ts ScorerConfig Used for configuring a scorer for a scorer job.

Properties

cotEnabled?

optional cotEnabled: boolean | null;
Defined in: src/types/new-api.types.ts Cot Enabled Whether to enable chain of thought for this scorer. Defaults to False for llm scorers.

filters?

optional filters: (object & NodeNameFilter | object & MetadataFilter)[] | null;
Defined in: src/types/new-api.types.ts Filters List of filters to apply to the scorer.

id

id: string;
Defined in: src/types/new-api.types.ts Id

inputType?

optional inputType: InputTypeEnum | null;
Defined in: src/types/new-api.types.ts What type of input to use for model-based scorers (sessions_normalized, trace_io_only, etc..).

modelName?

optional modelName: string | null;
Defined in: src/types/new-api.types.ts Model Name

modelType?

optional modelType: ModelType | null;
Defined in: src/types/new-api.types.ts Type of model to use for this scorer. slm maps to luna, and llm maps to plus

name?

optional name: string | null;
Defined in: src/types/new-api.types.ts Name

numJudges?

optional numJudges: number | null;
Defined in: src/types/new-api.types.ts Num Judges

outputType?

optional outputType: OutputTypeEnum | null;
Defined in: src/types/new-api.types.ts What type of output to use for model-based scorers (boolean, categorical, etc.).

scoreableNodeTypes?

optional scoreableNodeTypes: string[] | null;
Defined in: src/types/new-api.types.ts Scoreable Node Types List of node types that can be scored by this scorer. Defaults to llm/chat.

scorerType

scorerType: ScorerTypes;
Defined in: src/types/new-api.types.ts

scorerVersion?

optional scorerVersion: BaseScorerVersionDb | null;
Defined in: src/types/new-api.types.ts ScorerVersion to use for this scorer. If not provided, the latest version will be used.