test-flakiness

Analyze CI test logs to identify and classify flaky tests.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/dawn840705/claude-code-game-studios --skill test-flakiness-dawn840705
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: test-flakiness
Source: https://github.com/dawn840705/claude-code-game-studios/tree/main/skills/test-flakiness
Command: npx skills add https://github.com/dawn840705/claude-code-game-studios --skill test-flakiness-dawn840705

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Intermittent, non-deterministic tests undermine CI trust and slow release cycles by producing inconsistent results across runs.

Core Features & Use Cases

  • Identify flaky tests by aggregating pass/fail history across multiple CI runs and test suites.
  • Classify flakiness causes (timing, order dependency, external state, random seed) and propose remediation steps.
  • Generate a regression quarantine plan and update or reference a flaky-test registry.
  • Produce summary reports and actionable recommendations to fix or quarantine tests.

Quick Start

Run /test-flakiness with a CI log path or run scan to analyze all available CI logs.

Frequently Asked Questions about test-flakiness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect flaky tests from JUnit logs to stabilize CI?

To detect flaky tests from JUnit logs, you can analyze test results by aggregating pass/fail history across multiple CI runs to identify intermittent failures and stabilize your pipeline.

Why does my CI show intermittent test failures in Unity or Godot projects?

Intermittent CI failures in Unity, Godot, or Unreal projects are often caused by flaky tests exhibiting non-deterministic behavior due to timing, order dependency, external state, or random seeds.

How do I classify flakiness causes and generate a quarantine plan for failing tests?

You can classify flakiness causes and generate a regression quarantine plan by parsing test logs, evaluating pass/fail history, and producing actionable remediation recommendations to isolate unstable tests.

Can I analyze plain text CI logs to find non-deterministic test results?

Yes, you can analyze plain text CI logs to find non-deterministic test results by parsing the output and aggregating the historical pass and fail data to classify test flakiness.

What is the best way to aggregate pass/fail history across multiple test suites?

The best way to aggregate pass/fail history across multiple test suites is to scan available CI logs, classify the flakiness of each test, and generate a summary report with actionable fix recommendations.

Does this test flakiness detection work during the Polish or stabilization phases?

Yes, test flakiness detection is specifically applicable during Polish or stabilization phases when CI shows intermittent failures, helping you parse logs and update your flaky-test registry.