domains / families / software-engineering / promptfoo-evaluation

promptfoo-evaluation

separate

Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like "promptfoo", "eval", "LLM evaluation", "prompt testing", or "model comparison".

When to use

• setting up prompt testing
• creating evaluation configs (promptfooconfig.yaml)
• writing Python custom assertions
• implementing llm-rubric for LLM-as-judge
• managing few-shot examples in prompts
• model comparison

Skill page

Source