pr-failure-scan

Analyzes dotnet/runtime PR CI failures and drafts Known Build Error issues.

18.2k|5.6k|Updated Sep 24, 2019
One-click install
npx skills add https://github.com/dotnet/runtime --skill pr-failure-scan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: pr-failure-scan
Source: https://github.com/dotnet/runtime/tree/main/.github/skills/pr-failure-scan
Command: npx skills add https://github.com/dotnet/runtime --skill pr-failure-scan

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Triaging CI failures on dotnet/runtime pull requests is tedious: you must read Build Analysis output, check AzDO logs, search for existing Known Build Errors (KBEs), and file new issues. This Skill automates that triage loop for a single PR, skipping failures Build Analysis already knows and drafting or filing KBEs only for genuinely new failures.

Core Features & Use Cases

  • PR-targeted failure triage: Parses the Build Analysis check run and raw CI check runs for a PR's head SHA to separate known failures from unknown candidates, including pipelines excluded from Build Analysis.
  • KBE matching and drafting: Runs the shared KBE lookup flow, classifies each failure as new KBE needed, existing KBE missed by Build Analysis, or unhandled, and writes reviewable markdown draft files.
  • Dry-run and live modes: In dry-run mode it only writes local draft files; in live mode it asks for per-issue confirmation before creating GitHub issues under the authenticated user's account, with an AI disclosure note.
  • Use Case: A developer sees red CI on their PR and runs /pr-failure-scan <PR URL> dryrun to get draft KBE markdown files for each new failure without creating any GitHub issues.

Quick Start

Ask the assistant to run /pr-failure-scan on your dotnet/runtime pull request URL, optionally adding dryrun to only produce local draft files.

Frequently Asked Questions about pr-failure-scan

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I triage CI failures on a dotnet/runtime pull request?

Run /pr-failure-scan with the PR number or URL. The skill reads the Build Analysis check run and failed CI checks for the PR head SHA, skips failures Build Analysis already knows, and drafts or files Known Build Error issues for the rest.

How do I preview KBE issues without creating GitHub issues?

Append the dryrun token to the command, for example /pr-failure-scan <PR URL> dryrun. The skill writes one markdown draft file per new KBE to a session artifact or temporary directory and never creates GitHub issues.

Can I run pr-failure-scan on someone else's pull request?

Yes, but the skill compares the PR author with the authenticated GitHub user and requires explicit confirmation first. It warns that any created issues are filed under your account and their content is attributed to you.

Does pr-failure-scan handle pipelines excluded from Build Analysis?

Yes. It parses the Build Analysis warning section listing excluded pipelines, inspects the AzDO build, timeline, and logs for those that failed on the PR, and derives failure candidates itself, including draft-only KBEs when evidence is incomplete.

What happens when a failure matches an existing Known Build Error?

The skill runs the shared KBE lookup flow and, if a match exists that Build Analysis likely missed, reports the matched KBE number and URL with an explanation instead of filing a duplicate issue.

Why does pr-failure-scan ask before creating each GitHub issue?

Live mode requires per-issue confirmation because issues are created under the authenticated developer's account. Each prompt shows the proposed title, covered failures, draft file path, and an AI disclosure note is added to the issue body.