Short answer
An eval is a repeatable check against explicit requirements across fixed cases. It measures the tested task and revision, not every future use.
Boundary
Set pass criteria first, include ordinary and hostile cases, and rerun after changing prompts, models, tools, or policy.