post-eval

What problem does it solve?

Post-batch analysis pipeline that runs after an eval batch completes. Use after /eval-run or /overnight-eval finishes. Verifies results, runs analysis scripts, refreshes dashboard, writes summary. Does NOT launch new eval runs.

Core Features & Use Cases

• Verifies results from eval batches
• Runs analysis scripts to classify and summarize outcomes
• Refreshes dashboards and writes a concise summary for reporting
• Use Case: Apply after an eval batch across models/configurations to ensure quality and visibility

Quick Start

Invoke the post-eval pipeline after an eval batch completes to verify results and generate a summary.