What problem does it solve?
Automates rigorous, multi-layer validation of AI agents to ensure correct behavior, reliability, and security.
Core Features & Use Cases
- Layer 1: Output Quality (Unit-Level) validates that agents produce correct, well-structured outputs for typical inputs.
- Layer 2: Integration / Handoff Validation checks proper input/output handling between agents in workflows.
- Layer 3: Adversarial Output Validation challenges outputs to edge cases, bias, and completeness.
- Layer 4: Adversarial Verification (Peer Review) provides independent critique and validation against design goals.
- Layer 5: Security Validation tests resilience against misuse, prompt injection, and boundary conditions.
- Prompt Injection Resistance describes platform-level guardrails like subagent isolation, tool restrictions, and permission modes.
- Use Case: Integrate into CI pipelines to continuously validate agent behavior across diverse scenarios.
Quick Start
Invoke nw-agent-testing with representative inputs to run the five validation layers and generate an evaluation report.