triage-ci-flake

Name: triage-ci-flake
Availability: InStock
Author: Payload

Triage CI test failures and reproduce flaky tests across environments.

44.1k|4.0k|Updated Jan 5, 2021

Search Tags:#test automation #flaky tests #ci #test triage #reproduction workflow

Ready to run

npx skills add https://github.com/payloadcms/payload --skill triage-ci-flake-payloadcms

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: triage-ci-flake
Source: https://github.com/payloadcms/payload/tree/main/.claude/skills/triage-ci-flake
Command: npx skills add https://github.com/payloadcms/payload --skill triage-ci-flake-payloadcms

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill automates the process of triaging and identifying fixes for flaky tests in continuous integration environments, saving time and effort in diagnosing and resolving intermittent test failures.

Core Features & Use Cases

CI Failure Triage: Systematically analyzes CI test failures and identifies flaky tests.
Test Reproduction: Automates the reproduction of failing tests in a local development environment.
Bundled Code Testing: Checks the same test against a production build to ensure consistency.
Use Case: When a CI test fails on the main branch after a merge, this Skill can quickly determine if the failure is flaky and guide the developer through the steps to reproduce and fix the issue.

Quick Start

Run the 'triage-ci-flake' skill on a failing CI test to automate the process of identifying and fixing flaky tests.

Frequently Asked Questions about triage-ci-flake

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate triage for flaky tests in CI environments?▼

To automate flaky test triage in CI environments, this Skill parses CI logs to identify the test suite and test name, then executes the tests in both development and production environments to verify consistency. It systematically analyzes failures to determine if a test is genuinely flaky.

What is the best way to reproduce a CI test failure locally?▼

The best way to reproduce a CI test failure locally is to automate the reproduction workflow by parsing the CI logs for the specific failing test name and executing that targeted test directly within your local development environment.

Does this test triage workflow support validating bundled code in production builds?▼

Yes, this test triage workflow supports bundled code testing by executing the identified flaky tests against a production build, which ensures test consistency and verifies behavior across both development and production environments.

Why do intermittent test failures occur on the main branch after a merge?▼

Intermittent test failures on the main branch after a merge occur due to flaky tests. This Skill automates the triage process to quickly determine if a CI failure is flaky and guides you through the steps to reproduce and fix the issue.

Do I need specific CI tools to reproduce flaky tests?▼

Yes, you need specific tools for interacting with CI systems and executing tests. This Skill requires these dependencies to parse CI logs, identify test suites, and automatically run the tests in your required environments.

What are the limitations of automating CI failure triage for flaky tests?▼

The limitations of automating CI failure triage for flaky tests include a dependency on external tools for interacting with CI systems and executing tests, as the Skill itself relies on these integrations to parse logs and reproduce the failing tests.