architect-diagnose-test-flakes

Diagnose flaky tests from CI logs and git commits.

198|19|Updated Sep 15, 2025
One-click install
npx skills add https://github.com/iterate/iterate --skill architect-diagnose-test-flakes
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: architect-diagnose-test-flakes
Source: https://github.com/iterate/iterate/tree/main/.opencode/skills/architect-diagnose-test-flakes
Command: npx skills add https://github.com/iterate/iterate --skill architect-diagnose-test-flakes

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps teams diagnose why automated tests fail intermittently so CI becomes stable and engineers stop wasting time on repeated reruns and guesswork.

Core Features & Use Cases

  • Flake diagnosis from evidence: turns failing logs, recent code changes, and runtime context into a structured investigation.
  • Root-cause categorization: distinguishes timing, test order, shared state, and external dependency issues to guide the right fix.
  • Deterministic remediation plan: identifies a minimal reproduction and proposes the smallest reliable code change plus a guard test.

Quick Start

Diagnose the flaky behavior of the intermittently failing test using the provided CI logs, the relevant git commits, and the runtime context, then return a repro command, the likely root-cause category, and a minimal reliable fix plan with rollback notes.

Frequently Asked Questions about architect-diagnose-test-flakes

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I diagnose flaky tests causing intermittent CI failures?

To diagnose flaky tests causing intermittent CI failures, you analyze CI logs, recent git commits, and runtime context to classify root causes like timing, test order, shared state, or external dependencies, then build a deterministic reproduction.

What causes test flakiness and unpredictable automated test failures?

Test flakiness and unpredictable automated test failures are caused by timing issues, test execution order, shared mutable state, or external dependency instability, which require evidence-driven categorization to identify and resolve correctly.

How to fix flaky tests with a deterministic reproduction and guard test?

Fix flaky tests by constructing a minimal deterministic reproduction command, applying the smallest reliable code change, and adding a guard test with risk and rollback guidance to prevent future regressions.

Can I use CI logs and git history to troubleshoot unstable test pipelines?

Yes, you can use CI logs and git history to troubleshoot unstable test pipelines by turning failing logs, recent code changes, and runtime context into a structured investigation that identifies the exact flake root cause.

What's the best way to stop repeated test reruns and stabilize CI behavior?

The best way to stop repeated test reruns and stabilize CI behavior is performing root cause analysis on intermittent failures to distinguish timing, order, and state issues, then implementing a concrete fix and guard test plan.

When should I investigate test order and shared state for CI instability?

Investigate test order and shared state for CI instability when the same test fails unpredictably, retries are frequently needed, or timing and external dependencies are suspected as the source of flakiness.