domains / families / security / detecting-ai-model-prompt-injection-attacks

detecting-ai-model-prompt-injection-attacks

separate

Detects prompt injection using regex signature matching, heuristic scoring for structural anomalies, and DeBERTa-based transformer classification, flagging direct injections (system-prompt overrides, role-play escapes) and indirect injections (encoded payloads, obfuscation) per OWASP LLM Top 10 (LLM01:2025). Use for input validation layers in chatbots/agents/RAG pipelines, or for retrospectively classifying injection attempts in logs or incident investigations.

When to use

• Scanning user inputs to LLM-powered applications before they are forwarded to the model
• Building an input validation layer for chatbots, AI agents, or retrieval-augmented generation (RAG) pipelines
• Monitoring logs of LLM interactions to retrospectively identify prompt injection attempts
• Evaluating the effectiveness of existing prompt injection defenses through red-team testing
• Classifying prompt injection payloads during security incident investigations involving AI systems

When not to use

• Sole defense mechanism against prompt injection
• Detecting jailbreaks that do not involve injection of adversarial instructions

Skill page

Source