calibration-review

What problem does it solve?

Calibrate and audit a prediction agent by consolidating vault snapshots, heuristics, and database outcomes to guide disciplined improvements.

Core Features & Use Cases

• Read calibration state from vault snapshots, learned heuristics, and the predictions database to surface health metrics like Brier score and win rate.
• Perform domain-aware analyses to identify biases and opportunities for new heuristics and adjustments to persona weights.
• Generate actionable recommendations for adjusting thresholds, weights, and heuristic strategies during weekly meta-analyses.
• Support governance and decision-making with structured summaries and recommended next steps.

Quick Start

Run a calibration-review on the latest vault data to assess calibration metrics.