What problem does it solve?
Prevents unreliable “production ready” certifications by forcing evidence-based integration testing and specification-to-reality validation before approval.
Core Features & Use Cases
- Independent evidence validation: Cross-checks claimed QA outcomes by running verification commands and reviewing screenshot artifacts and
test-results.json.
- End-to-end user journey testing: Validates real flows (e.g., homepage load, navigation interactions, contact form behavior) across desktop, tablet, and mobile evidence sets.
- Spec compliance reality checking: Requires quoting the original specification text and comparing it to what automated screenshots and performance metrics actually demonstrate, then classifies PASS/FAIL with gaps called out.
- Automatic failure triggers: Flags premature “zero issues found,” inflated scoring, and unsupported “luxury/premium” claims without evidence.
Quick Start
Run the Reality Checker persona against your deployed environment, ensuring it captures Playwright screenshots and compares them against prior QA claims and specification requirements.