domains / families / agent-tooling / improve-skill-quality

improve-skill-quality

separate

Diagnoses and fixes skills in the dotnet/skills repository that lose to their own baseline, fail to activate, time out, or return "no credible improvement". Use when an evaluation verdict is a regression or underpowered, when a skill regressed after a change, when /evaluate reports no results, or when deciding whether a weak skill should be strengthened or retired. Do not use for scaffolding a brand-new skill (use create-skill) or a brand-new eval (use create-skill-test).

When to use

• An evaluation verdict is a regression, underpowered, or "no credible improvement".
• A skill wins in the isolated arm but not in the plugin arm, or is reported "not activated".
• `/evaluate` reports "Evaluation ran but produced no results".
• A skill scores well but costs too much (tokens, turns, wall time, plugin menu budget).
• Deciding whether to strengthen or retire a persistently weak skill.

When not to use

• Creating a new skill from scratch — use `create-skill`.
• Creating a new `eval.yaml` from scratch — use `create-skill-test`.
• Changing the harness itself (`eng/skill-validator`, `eng/vally-adapter`, `evaluation*.yml`).

Skill page

Source