What problem does it solve?
UltraQA removes the manual, repetitive work of running tests, builds, lints, or typechecks, diagnosing failures, and applying fixes by orchestrating an automated QA cycle until a defined quality goal is met.
Core Features & Use Cases
- Iterative QA Cycling: Runs up to five automated cycles of verification, diagnosis, and remediation (qa-tester → architect → executor).
- Multi-Goal Verification: Supports tests, build, lint, typecheck and custom success patterns with clear pass/fail exit conditions.
- Automated Diagnosis & Fixing: Delegates failure analysis to an architect role and applies precise fixes via an executor role, with failure-tracking and early-stop rules for repeated failures.
- Stateful Observability: Tracks progress using forge_state tools, emits clear per-cycle logs, and provides deterministic exit messages and cleanup.
- Use Case: Ideal for debugging CI failures, stabilizing flaky test suites, and automating local developer verification loops.
Quick Start
Start ultraqa to run the project's tests and iterate diagnosis and fixes until the defined quality goal is achieved.