test-triage

Automate triage of flaky tests in CI pipelines to restore stable builds.

Updated Feb 18, 2026
One-click install
npx skills add https://github.com/askaret/codex-skills --skill test-triage
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: test-triage
Source: https://github.com/askaret/codex-skills/tree/main/.agents/skills/test-triage
Command: npx skills add https://github.com/askaret/codex-skills --skill test-triage

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Use when tests fail or are flaky. Goal: get back to a stable green build with minimal behavior change. Do NOT 'fix' by weakening assertions unless justified.

Core Features & Use Cases

  • Reproduce failures by running the repository's standard test commands and isolating the failing project or suite.
  • Classify the failure into categories such as logic/assertion mismatch, race condition, environment/config differences, data dependence, snapshot drift, or external dependency issues not isolated.
  • Minimize the repro to the smallest failing unit: a single test, a single project, or a minimal seed dataset.
  • Fix with a product-focused approach: prioritize deterministic tests, guardrails, and regression coverage; document root cause.
  • Prevent recurrence by introducing guards (timeouts, retries for known flaky issues) and by recording root cause in concise notes.

Quick Start

Follow the workflow to reproduce failures, classify causes, minimize the failure, and implement fixes to restore a stable green build.

Frequently Asked Questions about test-triage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fix flaky tests in my CI pipeline?

You can prevent flaky test recurrence by introducing guardrails like timeouts and retries for known issues, documenting root causes, and adding regression coverage to ensure failures remain isolated and deterministic.

What is the best way to classify nondeterministic test failures?

The best way to classify nondeterministic test failures is to categorize them as logic mismatch, race condition, environment difference, data dependence, snapshot drift, or external dependency issue during the triage workflow.

Can I stabilize CI builds without weakening assertions?

Yes, you can stabilize CI builds without weakening assertions by prioritizing deterministic tests, guardrails, and regression coverage while documenting root causes rather than masking failures with relaxed checks.

Why does test order dependency cause flaky failures?

Test order dependency causes flaky failures because nondeterministic execution sequences reveal hidden state pollution or data dependence, requiring you to isolate the failing suite and minimize the repro to a single test.

When should I not use retries to fix flaky tests?

You should not use retries to fix flaky tests when the root cause is a logic or assertion mismatch, as masking failures with retries hides actual product defects instead of restoring a stable green build.