calibration-conformal

What problem does it solve?

This Skill provides guidance and tooling to implement or adjust temperature scaling, split conformal, Mondrian conformal, and general abstention policies for open-world detectors, ensuring calibrated decision making and reliable abstention behavior.

Core Features & Use Cases

• Calibration workflow: fit, serialize, and apply temperature scaling and nonconformity scores for conformal prediction.
• Abstention policy tooling: support for forced decision, threshold-based, and conformal abstention in inference.
• Use Case: calibrate a detector on a held-out split and generate temperature.json and conformal.json artifacts for reuse.

Quick Start

Fit calibration on a held-out dataset, compute conformal thresholds, and serialize artifacts for reuse in evaluation and inference.