skills.rest
petrkindlmann
petrkindlmannCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

test-reliability

Classify flaky test root causes and apply self-healing repairs with confidence scoring.

64|12|Updated Mar 23, 2026
Search Tags:#observability#self-healing#flaky-tests#test-reliability#qa-automation#quarantine#locator-healing
One-click install
npx skills add https://github.com/petrkindlmann/qa-skills --skill test-reliability
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: test-reliability
Source: https://github.com/petrkindlmann/qa-skills/tree/main/skills/test-reliability
Command: npx skills add https://github.com/petrkindlmann/qa-skills --skill test-reliability

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Flaky tests erode confidence and slow delivery. This skill provides a structured approach to diagnose, categorize, and repair flaky tests with observable evidence, self-healing locators, environment-aware diagnosis, and quarantine management.

Core Features & Use Cases

  • Locator resilience with multi-attribute selectors to reduce brittleness in element lookups.
  • Flake classification and root-cause analysis to guide targeted fixes.
  • Environment-aware healing that distinguishes test failures from environment issues.
  • Data healing and deterministic fixtures to regenerate stale test data.
  • Quarantine workflows to isolate flaky tests without blocking releases.
  • Observable repair with evidence, confidence scoring, and rollback checks.
  • Integrations with CI dashboards, ticketing, and QA pipelines to maintain reliability at scale.

Quick Start

Use the test-reliability skill to diagnose flaky tests and initiate automated self-healing repairs.

Frequently Asked Questions about test-reliability

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fix flaky tests in my test suite?▼

Fix flaky tests by classifying root causes with a decision-tree approach and applying environment-aware healing, data healing, and locator repairs to reduce flakiness while preserving test intent.

What is self-healing in QA automation?▼

Self-healing in QA automation uses multi-attribute locator strategies and environment-aware diagnosis to automatically repair brittle element lookups and regenerate stale test data without changing test intent.

How do I isolate flaky tests without blocking my CI pipeline?▼

Isolate flaky tests using quarantine-enabled workflows that separate unreliable tests from critical paths, ensuring releases proceed while flaky tests undergo diagnosis and repair.

Can I use deterministic fixtures to heal stale test data?▼

Yes, data healing applies deterministic fixtures to regenerate stale test data, distinguishing genuine test failures from environment issues across local and CI runs.

Does the test-reliability skill provide evidence for automated test repairs?▼

Yes, observable repair provides evidence, confidence scoring, and rollback checks for every self-healing action, ensuring transparent and verifiable test reliability improvements.

What is the best way to classify root causes of flaky tests?▼

Classify flaky test root causes using a decision-tree approach that distinguishes environment issues from data issues, guiding targeted fixes with observable evidence and confidence scoring.

Related Skills

Explore More Software Engineering Skills→
sumik5sumik5
1

mastering-playwright-testing

Optimize Playwright Test end-to-end suites with locator strategies, fixtures, and POM.

Community
Advanced
reaatechreaatech
2

Confidence Scoring Skill

Calculate calibrated confidence scores and uncertainty estimates for classification predictions.

Community
Intermediate
Rikinshah787Rikinshah787
5

se

Design scalable, fault-tolerant infrastructure with observability and disaster recovery strategies.

Community
Advanced
rabbicserabbicse

test-reliability

Diagnose and repair flaky Playwright end-to-end tests at runtime.

Community
Advanced