Flaky Test Analyzer

Analyze intermittent test failures and propose remediation steps.

129|51|Updated Mar 15, 2026
One-click install
npx skills add https://github.com/anhtester/antigravity-testing-kit --skill flaky-test-analyzer-anhtester
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Flaky Test Analyzer
Source: https://github.com/anhtester/antigravity-testing-kit/tree/main/.agent/skills/flaky_test_analyzer
Command: npx skills add https://github.com/anhtester/antigravity-testing-kit --skill flaky-test-analyzer-anhtester

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Flaky tests produce intermittent pass/fail results that undermine confidence in automation, waste CI resources, and slow development by causing false negatives and noisy triage work.

Core Features & Use Cases

  • Detect & Reproduce: Identify flaky tests from CI history, reproduce failures locally or in an isolated environment, and collect logs, traces, and screenshots.
  • Root Cause Classification: Determine whether failures stem from unstable locators, timing/race conditions, incorrect waits, test data conflicts, or environment dependencies.
  • Fix Recommendations & Verification: Suggest concrete fixes (stable locators, smart waits, data isolation, environment stabilization), apply remediation strategies, and verify stability through repeated reruns and a checklist-based validation.
  • Use Case: Triage a flakily failing UI test that intermittently times out in CI across different browsers and provide a prioritized plan to make it deterministic.

Quick Start

Analyze the intermittent failures in 'CheckoutFlowTest' using its latest CI logs and screenshots, classify the root cause, and propose concrete fixes with verification steps.

Frequently Asked Questions about Flaky Test Analyzer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fix flaky tests in my CI/CD pipeline?

To fix flaky tests in a CI/CD pipeline, you analyze test logs, stack traces, and screenshots to classify root causes like unstable locators or timing issues. This process produces concrete remediation steps using stable locators and smart waits to ensure deterministic test execution.

What causes intermittent UI automation test failures across different browsers?

Intermittent UI automation test failures across browsers are typically caused by race conditions, incorrect waits, unstable locators, or test data conflicts. Analyzing CI artifacts and screenshots helps isolate these environment dependencies to apply targeted fixes like smart waits and data isolation.

How do I find the root cause of a flaky Playwright or Selenium test?

Finding the root cause of a flaky Playwright or Selenium test involves collecting CI history, traces, and screenshots to reproduce the failure. The analysis classifies whether the instability stems from locator strategy, timing issues, or environment dependencies to guide remediation.

Can I use test stability analysis for API automated test suites?

Yes, test stability analysis applies to both UI and API automated test suites. By examining test logs and stack traces from local runs or cross-browser environments, it identifies timing issues and data conflicts to reduce false negatives and noisy triage work.

What is the best way to verify a fix for an unstable automation test?

The best way to verify a fix for an unstable automation test is through repeated reruns and a checklist-based validation. After applying remediation strategies like environment stabilization and smart waits, repeated execution confirms the test reliably passes without intermittent timeouts.

Why does my automation test intermittently time out in CI but pass locally?

An automation test intermittently timing out in CI but passing locally usually points to environment dependencies, race conditions, or test data conflicts. Analyzing CI artifacts and stack traces identifies these discrepancies to propose environment stabilization and correct wait strategies.