Prow Job Analyze Test Failure

Download Prow artifacts and analyze logs to identify test failure root causes.

112|305|Updated Oct 10, 2025
One-click install
npx skills add https://github.com/openshift-eng/ai-helpers --skill prow-job-analyze-test-failure
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Prow Job Analyze Test Failure
Source: https://github.com/openshift-eng/ai-helpers/tree/main/plugins/prow-job/skills/prow-job-analyze-test-failure
Command: npx skills add https://github.com/openshift-eng/ai-helpers --skill prow-job-analyze-test-failure

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Diagnosing Prow CI test failures involves sifting through vast amounts of logs and artifacts. This skill automates the initial analysis, helping to quickly identify the root cause of a failed test by correlating logs, events, and code.

Core Features & Use Cases

  • Automated Failure Analysis: Downloads Prow job artifacts and analyzes build-log.txt to pinpoint test failures.
  • Stack Trace & Code Inspection: Gathers relevant stack traces and inspects related code in the repository.
  • Evidence Collection: Collects and presents evidence from logs, events, and other JSON/YAML artifacts related to the failure.
  • Use Case: When a specific test fails in a Prow job, provide the job URL and the test name. This skill will perform an initial investigation, providing a summary of the failure, potential root causes, and supporting evidence.

Quick Start

Example: Analyze a specific test failure

User: "Analyze test failure TestKarpenter/EnsureHostedCluster/ValidateMetricsAreExposed in this Prow job: https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/openshift_hypershift/6731/pull-ci-openshift-hypershift-main-e2e-aws/1962527613477982208"

Frequently Asked Questions about Prow Job Analyze Test Failure

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze Prow CI test failures to find the root cause?

Analyzing Prow test failures involves downloading job artifacts and logs, then examining build-log.txt and event timelines to identify what broke. This skill automates that process: provide the Prow job URL and test name, and it retrieves artifacts, correlates logs and events, inspects related code, and generates a detailed failure report pinpointing the root cause.

What information do I need to provide to analyze a Prow test failure?

You need the Prow job URL (from test-platform-results) and the specific test name that failed. The skill parses the URL, downloads build logs and interval files, and uses those artifacts to perform the initial investigation and produce a root-cause summary.

Can I use this to debug E2E test failures in Kubernetes CI/CD pipelines?

Yes. This skill is designed for Prow jobs running Kubernetes-based tests, including E2E scenarios. It analyzes interval files for E2E timelines, stack traces, and event logs to determine why tests failed in your CI/CD environment.

What does the failure report include?

The report collects evidence from logs, events, and artifacts, then presents a structured summary of the failure, potential root causes, and supporting evidence from stack traces and code inspection. It correlates multiple log sources to pinpoint where and why the test broke.

Do I need to manually download Prow job artifacts before using this skill?

No. The skill automates artifact download and log retrieval from the job URL, including build-log.txt and JSON/YAML event files. You provide only the job URL and test name; it handles the rest of the artifact gathering and analysis.