ultraqa

Coordinates iterative cycles of verification, diagnosis, and repair for automated QA workflows.

20|6|Updated Feb 13, 2026
One-click install
npx skills add https://github.com/realsigridjin/oh-my-codex --skill ultraqa-realsigridjin
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ultraqa
Source: https://github.com/realsigridjin/oh-my-codex/tree/main/skills/ultraqa
Command: npx skills add https://github.com/realsigridjin/oh-my-codex --skill ultraqa-realsigridjin

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

UltraQA reduces the manual effort of diagnosing and resolving failed tests, builds, lint checks, and type checks by coordinating repeated verification and repair cycles until the defined quality goal is met or a clear stopping condition is reached.

Core Features & Use Cases

  • Goal-Based Verification: Run test, build, lint, typecheck, custom-pattern, or interactive QA workflows.
  • Iterative Diagnosis and Repair: Have an architect analyze failures and an executor apply targeted fixes before rerunning verification.
  • Failure and State Tracking: Track cycles, detect repeated failures, report progress, and clean up workflow state on completion or cancellation.
  • Use Case: When a project has several failing tests, use UltraQA to run the suite, diagnose the root cause, apply fixes, and repeat until the tests pass or the workflow surfaces an actionable diagnosis.

Quick Start

Use the ultraqa skill with the tests goal to run verification, diagnose failures, apply fixes, and repeat until the test suite passes.

Frequently Asked Questions about ultraqa

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate fixing failing tests, lint errors, and type check failures?

Automated QA cycles coordinate repeated verification and repair by having an architect diagnose failures and an executor apply fixes until tests, lint, and type checks pass. This iterative fixing approach reduces manual debugging effort across your build verification process.

What is iterative build verification and how does it diagnose repeated failures?

Iterative build verification runs your test suite, analyzes failures, applies targeted fixes, and reruns checks within bounded retries. It tracks failure cycles to detect repeated issues, reports progress, and surfaces actionable diagnoses when quality goals cannot be met automatically.

Can I use custom success criteria and interactive service testing for regression debugging?

Custom success criteria and interactive service testing are supported for regression debugging workflows. You define project verification commands, and the system cycles through testing, diagnosis, and fixes until your specific quality goals pass or a clear stopping condition is reached.

Do I need to provide project verification commands for automated QA automation?

Project verification commands are required for automated QA automation to function. The workflow depends on your test, build, lint, and type check commands to run verification cycles, diagnose failures, and apply iterative fixes until all defined quality goals pass.

What happens when iterative fixing cannot resolve failing tests after bounded retries?

When iterative fixing cannot resolve failing tests after bounded retries, the workflow surfaces an actionable diagnosis and stops. It tracks repeated failures throughout the cycles, reports progress, and cleans up persisted workflow state on completion or cancellation.

What's the best way to run QA cycles that coordinate diagnosis and fixes for failing builds?

The best way to run QA cycles is using a goal-based verification approach where an architect analyzes failures and an executor applies targeted fixes before rerunning checks. This coordinates diagnosis and repair automatically until your test suite passes or stopping conditions are met.