test-report

Generate categorized Markdown evidence reports from promptfoo test results.

6|Updated Mar 4, 2026

Search Tags:#automation #root-cause-analysis #promptfoo #markdown-report #test-report #evidence-report

Ready to run

npx skills add https://github.com/rnagrodzki/sdlc-marketplace --skill test-report-rnagrodzki

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: test-report
Source: https://github.com/rnagrodzki/sdlc-marketplace/tree/main/.claude/skills/test-report
Command: npx skills add https://github.com/rnagrodzki/sdlc-marketplace --skill test-report-rnagrodzki

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Analyze promptfoo test results and generate a structured evidence report from pre-computed data produced by test-report-prepare.js, organizing failures, root-cause analysis, and a prioritized fix plan.

Core Features & Use Cases

Generate categorized Markdown test reports with failure diagnosis and a prioritized fix plan from pre-computed data.
Consume test data produced by test-report-prepare.js to support post-run analysis and evidence generation.
Integrate into CI or local workflows to produce shareable test-evidence documents.

Quick Start

Run test-report-prepare.js to pre-compute data, then run the /test-report command to generate the evidence report.

Frequently Asked Questions about test-report

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I generate an evidence report from promptfoo test results?▼

To generate an evidence report from promptfoo test results, run the test-report-prepare.js script to pre-compute data, then execute the /test-report command to produce a structured Markdown report with failure categorization and root-cause analysis.

What is root-cause analysis in promptfoo test reporting?▼

Root-cause analysis in promptfoo test reporting is the process of categorizing behavioral and exec evaluation failures, diagnosing their underlying causes, and proposing a prioritized fix plan within a structured Markdown evidence document.

Does the test reporting workflow support both behavioral and exec promptfoo evaluations?▼

Yes, the test reporting workflow supports both behavioral and exec promptfoo evaluation types. It analyzes pre-computed data from test-report-prepare.js to categorize failures and perform root-cause analysis across both evaluation formats.

Can I integrate promptfoo evidence report generation into a CI pipeline?▼

Yes, you can integrate promptfoo evidence report generation into CI pipelines. Running test-report-prepare.js and the /test-report command produces shareable test-evidence Markdown documents suitable for automated artifact generation and review.

Do I need to run a preparation script before generating a markdown test report?▼

Yes, you must run test-report-prepare.js to pre-compute data before generating a Markdown test report. The /test-report command consumes this prepared data to perform root-cause analysis and output the final evidence document.

What is the best way to document promptfoo test failure diagnosis and fix plans?▼

The best way to document promptfoo test failure diagnosis is generating a structured Markdown evidence report. It categorizes failures, provides root-cause analysis, and proposes a prioritized fix plan with instructions for traceability and reproducibility.