review-test-reliability

Audit AutoHotkey test suites for reliability anti-patterns in the tests/ directory.

1|Updated Jan 12, 2026
One-click install
npx skills add https://github.com/cwilliams5/Alt-Tabby --skill review-test-reliability
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: review-test-reliability
Source: https://github.com/cwilliams5/Alt-Tabby/tree/main/.claude/skills/review-test-reliability
Command: npx skills add https://github.com/cwilliams5/Alt-Tabby --skill review-test-reliability

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill identifies and helps fix intermittent failures in your AutoHotkey test suite, ensuring more stable and reliable automated testing.

Core Features & Use Cases

  • Flaky Test Detection: Pinpoints common anti-patterns like blind sleeps, instant asserts, and unreliable signals.
  • Targeted Auditing: Focuses specifically on test reliability, not general code quality or coverage.
  • Use Case: A CI pipeline is failing intermittently due to tests that sometimes pass and sometimes fail without clear reasons. This Skill analyzes the test code to find the root cause of these flakes.

Quick Start

Audit the AutoHotkey test suite in the tests/ directory for reliability anti-patterns.

Frequently Asked Questions about review-test-reliability

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find flaky tests in my AutoHotkey test suite?

Flaky test detection in AutoHotkey involves auditing the tests/ directory for reliability anti-patterns like blind sleeps, instant asserts after asynchronous operations, and stale signal checks to pinpoint specific code locations causing intermittent failures.

What causes intermittent failures in AutoHotkey test automation?

Intermittent failures in AutoHotkey test automation are caused by reliability anti-patterns like blind sleeps, instant asserts after asynchronous operations, and stale signal checks. Auditing test code identifies these root causes for remediation.

How do I fix blind sleeps and instant asserts in AHK tests?

Fix blind sleeps and instant asserts in AHK tests by auditing for these specific anti-patterns to identify their exact code locations. The audit provides actionable recommendations for remediation to improve test stability.

Does this AutoHotkey test audit check production code or only test files?

This AutoHotkey test audit focuses exclusively on test code within the tests/ directory. It deliberately excludes production code and general static analysis to target only test reliability and stability anti-patterns.

What is the best way to improve AutoHotkey test reliability in CI pipelines?

The best way to improve AutoHotkey test reliability in CI pipelines is auditing for flaky patterns like stale signal checks. Identifying specific code locations and applying actionable remediation recommendations stabilizes intermittent test failures.