Does the evidence fit the intended work?
Before using an external evaluation to support an operational decision, we examine six points of correspondence.
- Task
- Does the evaluated work resemble the actual task distribution, including routine and difficult cases?
- Success
- Does the metric capture the required quality and consequential failures?
- System
- Are the model, prompts, tools, permissions, and review process materially comparable?
- Workflow
- Does the evaluation include context gathering, iteration, coordination, and integration?
- Reliability
- Are repetition, variation, deferral, recovery, and serious failures assessed at the required level?
- Time
- Does the evidence apply to the current system, with version changes and contamination risks accounted for?
A mismatch identifies evidence still needed. This is an analytical check, not a certification or a universal passing score.