domains / families / security / defending-llms-with-guardrails

defending-llms-with-guardrails

separate

Deploys Llama Guard 3 safety classification, NeMo Guardrails programmable dialogue rails, and LLM Guard input/output scanner pipelines as complementary runtime defenses that inspect and constrain LLM prompts and responses. Use when adding a production runtime safety layer to an LLM, RAG, or agent application to block jailbreaks, prompt injection (OWASP LLM01), toxic content, or sensitive-data leakage before it reaches or leaves the model.

When to use

• When deploying an LLM/RAG/agent application to production and needing a runtime safety layer.
• When you must block jailbreaks and prompt injection (OWASP LLM01) before they reach the model.
• When you must moderate model output for toxicity, PII leakage, secrets, or off-topic responses.
• When validating that a guardrail configuration actually blocks a corpus of known-bad payloads.
• When layering defense-in-depth: a deterministic scanner (LLM Guard) plus a semantic classifier (Llama Guard) plus dialog rails (NeMo).

When not to use

• Testing against systems you do not own or are not authorized to assess

Skill page

Source