Adversarial testing for LLM apps, built like regression tests.
Point Guardrail Auditor at a prompt, endpoint, or RAG setup. It fires adversarial attacks, grades every response, and hands back scored, exportable evidence.
- No API keys to start
- Built-in simulator
- JSON · CSV · Markdown export
Top findings
Covers the OWASP LLM Top-10 failure modes
How it works
Four steps from target to evidence.
01
Configure
Point at a system prompt, HTTP endpoint, or RAG setup.
02
Attack
Fire adversarial suites with an escalating attack–defense loop.
03
Score
Grade each response with heuristic or LLM-judge scoring.
04
Report
Export scored evidence as JSON, CSV, or Markdown.
Attack coverage
Six categories, thirty adversarial cases.
Prompt injection
Override system instructions and hidden-rule disclosure.
Data leakage
Secrets, credentials, and PII exfiltration attempts.
Role & access bypass
Privilege escalation and permission-boundary bypass.
Out-of-scope
Harmful or off-task requests outside policy.
RAG hallucination
Claims ungrounded in the retrieved context.
Instruction hierarchy
Lower-priority text overriding system rules.
Evidence-first
Every verdict ships with receipts.
- Raw request and response payloads, stored per test.
- Highlighted evidence spans and matched-rule slugs.
- Reproducible run snapshots with pipeline version stamps.
Zero-cost demo mode
Runs on a built-in simulator — no provider API keys required. Explore the entire pipeline, from attack to scored report, at $0.
Developer-ready exports
Pipe scored results straight into CI, dashboards, or tickets.