skills.rest
brand6
brand6COMMUNITY
Explore all skills by this author →
GitHub

test-flakiness

Analyze CI logs and historical test results to detect flaky tests.

Updated Apr 22, 2026
Search Tags:#automation#quality-assurance#log-analysis#flaky-tests#ci-logs#test-regression
One-click install
npx skills add https://github.com/brand6/Claude-Code-Game-Studios-zh-auto --skill test-flakiness-brand6
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: test-flakiness
Source: https://github.com/brand6/Claude-Code-Game-Studios-zh-auto/tree/main/.claude/skills/test-flakiness
Command: npx skills add https://github.com/brand6/Claude-Code-Game-Studios-zh-auto --skill test-flakiness-brand6

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Reads CI logs and historical test results to detect intermittent failures, summarizing pass rates and surfacing unstable tests for remediation and registry maintenance.

Core Features & Use Cases

  • Automated flaky-test detection: Analyze CI logs and historical results to flag non-deterministic tests.
  • Registry maintenance: Update a flaky-tests registry with new findings and statuses for ongoing quality control.
  • Actionable remediation guidance: Recommend isolation or fix strategies for each unstable test based on failure patterns.

Quick Start

Analyze CI logs to identify flaky tests and update the registry.

Frequently Asked Questions about test-flakiness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I identify flaky tests from CI logs?▼

Flaky test detection works by parsing CI logs and historical test results to compute pass rates and flag non-deterministic failures. It isolates intermittent failures by comparing historical outcomes, enabling registry updates and targeted remediation planning.

What is the best way to maintain a flaky-tests registry?▼

The best way to maintain a flaky-tests registry is to continuously parse CI logs and historical test results to update test statuses. This tracks non-deterministic behavior and records actionable isolation recommendations for ongoing quality control.

How do I compute pass rates for intermittent test failures?▼

You compute pass rates for intermittent test failures by parsing CI logs and analyzing historical test results. This calculation identifies non-deterministic tests, summarizes their stability, and generates actionable guidance for remediation planning.

Does flaky test detection work with existing regression suites?▼

Yes, flaky test detection applies to ongoing development workflows where a regression suite is actively maintained. It analyzes historical CI test results to isolate intermittent failures and generate remediation recommendations.

What isolation strategies are recommended for non-deterministic tests?▼

Isolation strategies for non-deterministic tests are generated by analyzing failure patterns from CI logs. The system provides actionable remediation guidance to isolate unstable tests and facilitate registry maintenance.

Related Skills

Explore More Software Engineering Skills→
polsegupolsegu

test-flakiness

Detect nondeterministic failures by parsing CI logs and aggregating per-test pass/fail histories.

Community
Intermediate
ed3daied3dai
5

playwright-debugging

Diagnose flaky Playwright tests with structured debugging steps.

Official
Intermediate
J03Fr0stJ03Fr0st

ci-cd-and-automation

Automate CI/CD pipeline setup with GitHub Actions and quality gates.

Community
Advanced
solace-illsolace-ill

test-flakiness

Analyze CI logs and JUnit/XML results to detect flaky tests.

Community
Intermediate