flaky-test-detector

Detect flaky tests in Python and Java test suites via static analysis.

142|14|Updated Feb 14, 2026
One-click install
npx skills add https://github.com/ArabelaTso/Skills-4-SE --skill flaky-test-detector
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: flaky-test-detector
Source: https://github.com/ArabelaTso/Skills-4-SE/tree/main/skills/flaky-test-detector
Command: npx skills add https://github.com/ArabelaTso/Skills-4-SE --skill flaky-test-detector

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the frustration and wasted time caused by non-deterministic or unreliable tests that fail intermittently, making it difficult to trust the test suite and identify genuine bugs.

Core Features & Use Cases

  • Flaky Test Identification: Detects tests exhibiting inconsistent pass/fail behavior using static code analysis and test result analysis.
  • Root Cause Analysis: Provides insights into common causes of flakiness, such as timing issues, state management problems, and external dependencies.
  • Remediation Guidance: Offers specific strategies and code examples to fix identified flaky tests.
  • Use Case: When your CI/CD pipeline reports random test failures, use this Skill to analyze the test suite, pinpoint the flaky tests, and receive actionable advice on how to make them stable.

Quick Start

Analyze the provided test execution results to identify flaky tests.

Frequently Asked Questions about flaky-test-detector

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find flaky tests in my CI/CD pipeline?

To find flaky tests in your CI/CD pipeline, analyze test execution results and perform static code analysis to detect tests exhibiting inconsistent pass/fail behavior, identifying non-deterministic failures.

What causes intermittent test failures in Python and Java?

Intermittent test failures are commonly caused by timing issues, state management problems, and external dependencies. Analyzing test stability helps pinpoint these root causes in Python and Java frameworks.

Does flaky test detection work with pytest and JUnit?

Flaky test detection supports both pytest and unittest for Python, alongside JUnit and TestNG for Java. It analyzes test results and static code to identify unreliable tests across these frameworks.

How do I fix non-deterministic tests once they are identified?

To fix non-deterministic tests, use remediation guidance that offers specific strategies and code examples to resolve timing, state management, and dependency issues causing the flakiness.

What is the best way to analyze test reliability for intermittent failures?

The best way to analyze test reliability for intermittent failures is combining static code analysis with test result analysis to pinpoint non-deterministic behavior and receive actionable remediation advice.