Home > intention-kernel/testing > EvaluationOptions

EvaluationOptions interface

Runner dependencies and bounded execution controls.

Signature:

export interface EvaluationOptions

Properties

Property	Modifiers	Type	Description
adapter	readonly	EvaluationAdapter	Application-owned transport.
allowExternalWrites?	readonly	boolean	(Optional) Explicit effect authorization passed to the host adapter through the scenario boundary.
concurrency?	readonly	number	(Optional) Independent concurrent cases; default 1, maximum 32.
evaluators?	readonly	EvaluationEvaluators	(Optional) Optional domain checks; identifiers are validated before any session opens.
maxCases?	readonly	number	(Optional) Maximum expanded case count; default 1000.
maxFailures?	readonly	number	(Optional) Stop scheduling after this many failed/error cases; already-running cases finish.
onCheckpoint?	readonly	(report: EvaluationReport) => void | Promise<void>	(Optional) Persist a deeply immutable snapshot; unchanged cases retain identity. Rejection stops further scheduling.
onEvent?	readonly	(event: EvaluationEvent) => void | Promise<void>	(Optional) Ordered observer invoked only after checkpoint persistence.
repetitions?	readonly	number	(Optional) Number of isolated runs per variant; default 1.
resume?	readonly	EvaluationReport	(Optional) Compatible snapshot for continuing unfinished cases.
retryFailed?	readonly	boolean	(Optional) Rerun failed/error cases in new sessions; preserves the prior run through resumedFrom.
scenarioIds?	readonly	readonly string[]	(Optional) Select scenario IDs; unknown IDs fail before execution.
signal?	readonly	AbortSignal	(Optional) Cooperative cancellation, with bounded waiting even if an adapter ignores it.
suite	readonly	EvaluationSuite	Validated again at the public execution boundary.
tags?	readonly	readonly string[]	(Optional) Select scenarios matching any requested tag.
target	readonly	Readonly<{ id: string; fingerprint: string; }>	Explicit model/agent/domain-evaluator compatibility identity.
timeoutMs?	readonly	number	(Optional) Per-operation/evaluator deadline in milliseconds; default 120000.