Evaluation set
An evaluation set is a curated pack of real inputs and expected outcomes used to score AI behaviour over time.
How it works
Collect successes, failures and ambiguous cases. Score with a rubric humans trust. Run the set on every prompt or model change. Without it, demos lie.
Example
Forty historic support threads with labelled correct actions become the gate for shipping a new agent prompt.