fix-pr-tests

Diagnose and fix failing GitHub pull request CI tests by classifying failures.

22|3|Updated Jul 28, 2024
One-click install
npx skills add https://github.com/webdevcody/go-mailing-list --skill fix-pr-tests-webdevcody
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: fix-pr-tests
Source: https://github.com/webdevcody/go-mailing-list/tree/main/.claude/skills/fix-pr-tests
Command: npx skills add https://github.com/webdevcody/go-mailing-list --skill fix-pr-tests-webdevcody

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps you quickly diagnose why a GitHub pull request’s CI test checks are failing and fixes the correct side without masking real regressions.

Core Features & Use Cases

  • Failing check triage: Locates the exact failing job and extracts the precise assertion message and code location from GitHub Actions logs.
  • Local reproduction first: Runs only the failing test to confirm whether the failure reproduces and identify CI-vs-local environment differences.
  • Correct classification and minimal fix: Determines whether the issue is a real bug, a stale test, or a flake, then applies the minimum appropriate change and re-verifies.

Quick Start

Ask the AI to fix the failing tests on PR #123 by pulling the failing job logs, reproducing the failure locally, classifying it, applying the smallest correct patch, and pushing the verified fix.

Frequently Asked Questions about fix-pr-tests

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fix failing GitHub Actions tests on a pull request?

To fix failing GitHub Actions tests on a pull request, the system retrieves failing check logs, reproduces the single test failure locally, classifies the root cause as a real bug or stale expectation, and applies a minimal safe patch.

How do I reproduce a CI test failure locally that only happens on GitHub?

Reproducing a CI test failure locally requires running only the specific failing test to confirm the failure and identify any CI-vs-local environment differences that may explain non-reproducible results.

How can I tell if a failing CI test is a real bug or a flaky test?

To tell if a failing CI test is a real bug or a flaky test, classify the failure by reproducing it locally and running repeated executions for deterministic flake identification, distinguishing real bugs from stale tests or environment flakes.

Why does my pull request test pass locally but fail in CI?

Your pull request test passes locally but fails in CI due to CI-vs-local environment differences, which you can identify by extracting assertion details from GitHub Actions logs and reproducing only the single failing test locally.

Is it safe to automatically patch failing tests based on GitHub Actions logs?

Automatically patching failing tests based on GitHub Actions logs is safe when strict safety rules are applied to avoid editing tests or production code on guessing, ensuring accurate error extraction and classification before applying changes.