bisect-model-quality

What problem does it solve?

This Skill helps you pinpoint the first model checkpoint that fails a quality gate, so you can stop guessing where a regression began and focus on the exact training step that broke performance.

Core Features & Use Cases

• Binary search over checkpoints: Evaluates an ordered list of ONNX models efficiently to localize the first failing checkpoint.
• Quality-gate testing: Checks held-out data against PLCC, SROCC, or RMSE thresholds to determine whether each checkpoint passes or fails.
• Operational guardrails: Validates that you have enough models, a parquet file with the required target column, and a clean working tree before running.
• Use case: A training pipeline suddenly produces worse video-quality scores; use this Skill to identify the earliest checkpoint that crossed the regression boundary.

Quick Start

Run the bisect-model-quality skill on your ordered ONNX checkpoints and a held-out parquet with a MOS column to localize the first checkpoint that falls below your chosen PLCC, SROCC, or RMSE gate.