triage-ci-flake

To automate flaky test triage in CI environments, this Skill parses CI logs to identify the test suite and test name, then executes the tests in both development and production environments to verify consistency. It systematically analyzes failures to determine if a test is genuinely flaky.

The best way to reproduce a CI test failure locally is to automate the reproduction workflow by parsing the CI logs for the specific failing test name and executing that targeted test directly within your local development environment.

Yes, this test triage workflow supports bundled code testing by executing the identified flaky tests against a production build, which ensures test consistency and verifies behavior across both development and production environments.

Intermittent test failures on the main branch after a merge occur due to flaky tests. This Skill automates the triage process to quickly determine if a CI failure is flaky and guides you through the steps to reproduce and fix the issue.

Yes, you need specific tools for interacting with CI systems and executing tests. This Skill requires these dependencies to parse CI logs, identify test suites, and automatically run the tests in your required environments.

The limitations of automating CI failure triage for flaky tests include a dependency on external tools for interacting with CI systems and executing tests, as the Skill itself relies on these integrations to parse logs and reproduce the failing tests.