flaky-test-specialist

Community

Stabilize flaky tests for reliable CI

AuthorWhaleylaw
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Intermittent and non-deterministic test failures caused by timing issues, race conditions, shared state, resource leaks, or environment-specific behavior that make test suites unreliable in local development or CI pipelines.

Core Features & Use Cases

  • Identify flaky tests through repeated runs and CI log analysis and classify root causes (timing, order, environment, network).
  • Replace arbitrary sleeps with condition-based waits, enforce proper async/await usage, and apply Playwright/Vitest best practices to remove timing dependencies.
  • Improve test isolation by resetting state, cleaning resources, mocking network/time, and recommending deterministic patterns for concurrent operations; useful for Playwright end-to-end tests and Vitest unit tests.
  • Debugging aids such as adding logs, screenshots, traces, and running tests in isolation or with retries as a last-resort mitigation.

Quick Start

Diagnose the intermittent test by running it repeatedly, identify missing waits or shared state, replace sleeps with condition-based waits or mocks, and verify the fix by re-running the test 50+ times in CI.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: flaky-test-specialist
Download link: https://github.com/Whaleylaw/llm-lawyer/archive/main.zip#flaky-test-specialist

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.