domains / families / software-engineering / analyze-exports

analyze-exports

separate

Analyze tau2-bench task export files to identify exactly where and why tasks failed. Map failures to specific conversation rounds, show root causes, check whether relevant documentation was available, and cite sources. Use this skill whenever you need to debug a tau2-bench evaluation, understand why an agent made wrong decisions, identify missing knowledge, or review task performance—especially when context length, eligibility criteria, or policy compliance might be at fault.

When to use

• **Where it failed** — the exact round (Assistant #X, User #Y) and tool-call sequence
• **What should have happened** — ground truth from the task explanation
• **Why it failed** — root cause (missing logic, wrong arguments, bad order, policy misunderstanding)
• **Was the docs available?** — whether the KB had the answer the agent needed
• **Evidence** — quotes and citations from both the transcript and source documents

Skill page

Source