domains / families / security / red-teaming-llms-with-garak
red-teaming-llms-with-garak
separate
Runs NVIDIA garak probe suites (jailbreak, prompt injection, data
When to use
- When you need a fast, repeatable baseline security assessment of an LLM before or after deployment.
- When validating that a guardrail, system prompt, or safety fine-tune actually reduces jailbreak and injection success rates (run before/after and compare hit rates).
- When producing evidence for an AI risk assessment or model card security section (NIST AI RMF MEASURE-2.7).
- When triaging which OWASP LLM Top 10 risks (LLM01 prompt injection, LLM02 sensitive information disclosure, LLM07 system prompt leakage) actually manifest in your model.
- When regression-testing an LLM endpoint in CI after model or prompt changes.
When not to use
- unauthorized probing of third-party LLM APIs
- probing systems without explicit written permission
Skill page
Source