domains / families / agent-tooling / evaluation

evaluation

combined

This skill should be used when building agent evaluation systems: deterministic checks, regression suites, multi-dimensional rubrics, quality gates, production monitoring, baseline comparison, and outcome measurement for agent pipelines. Build evaluation frameworks for agent systems. Use when testing agent performance systematically, validating context engineering choices, or measuring improvements over time.

When to use

• Build evaluation frameworks for agent systems Use this skill when working with build evaluation frameworks for agent systems.
• Testing agent performance systematically
• Validating context engineering choices
• Measuring improvements over time
• Catching regressions before deployment
• Building quality gates for agent pipelines
• Comparing different agent configurations
• Evaluating production systems continuously

When not to use

• Use this skill only when the task clearly matches the scope described above.
• Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
• Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.

Skill page

Conflict

The second copy is a direct mirror of the first (it cites the first repository as its source), but it is not a faithful reproduction. It introduces specific, conflicting performance metrics (the '95% Finding' with 80/10/5 variance splits) that the first copy explicitly avoids by using qualitative descriptors ('Primary', 'Secondary'). It also includes specific model recommendations (Claude Sonnet 4.5, GPT-5.2) and a 'risk: safe' metadata field absent from the original. Because the copies disagree on the quantitative basis for evaluation design, crowning one would hide a real alternative interpretation of the underlying research.