triage-flaky-test

Investigating flaky tests requires analyzing historical failure patterns and failure rates within your CI/CD pipeline to determine root causes. This skill automates that triage process to identify why intermittent test failures occur.

Triage intermittent test failures by evaluating the root cause and blast radius of the failing test. This skill analyzes historical failure data to recommend specific actions, advising whether to fix, quarantine, or escalate the issue.

Yes, analyzing flaky test history with this skill requires the datadog-mcp or pup CLI. These dependencies are necessary for data retrieval and modification when operating within your CI/CD pipeline context.

Diagnose flaky test failure rates by running the triage command with the specific test name and repository URL. The skill retrieves historical data to identify failure rates and categorize the test failures.

Quarantine a flaky test instead of fixing it when the root cause and blast radius analysis indicate it is the most viable option. The skill recommends whether to quarantine, fix, or escalate based on the historical failure patterns in your pipeline.