test-report

To generate an evidence report from promptfoo test results, run the test-report-prepare.js script to pre-compute data, then execute the /test-report command to produce a structured Markdown report with failure categorization and root-cause analysis.

Root-cause analysis in promptfoo test reporting is the process of categorizing behavioral and exec evaluation failures, diagnosing their underlying causes, and proposing a prioritized fix plan within a structured Markdown evidence document.

Yes, the test reporting workflow supports both behavioral and exec promptfoo evaluation types. It analyzes pre-computed data from test-report-prepare.js to categorize failures and perform root-cause analysis across both evaluation formats.

Yes, you can integrate promptfoo evidence report generation into CI pipelines. Running test-report-prepare.js and the /test-report command produces shareable test-evidence Markdown documents suitable for automated artifact generation and review.

Yes, you must run test-report-prepare.js to pre-compute data before generating a Markdown test report. The /test-report command consumes this prepared data to perform root-cause analysis and output the final evidence document.

The best way to document promptfoo test failure diagnosis is generating a structured Markdown evidence report. It categorizes failures, provides root-cause analysis, and proposes a prioritized fix plan with instructions for traceability and reproducibility.