What problem does it solve?
Research experiments need a trustworthy reference point before any comparison is meaningful, but reproducing or validating baselines is error-prone, often producing fabricated metrics, unverified runs, or incomparable results. This Skill enforces a disciplined workflow for attaching, importing, reproducing, or repairing a baseline so downstream experiment and writing stages can compare against it fairly.
Core Features & Use Cases
- Four baseline routes: Attach an existing reusable baseline, import a baseline package, reproduce from a source paper and repo, or repair a broken baseline, with a fast-path default for cheap validation.
- Mandatory verification and comparability contract: Classifies outcomes as verified_match, verified_close, verified_diverged, or broken, and records task, dataset, split, metric keys, and deviations in a canonical metric_contract.json.
- Durable artifacts and gating: Produces PLAN.md, CHECKLIST.md, verification notes, and a confirmed baseline gate via artifact.confirm_baseline, or an explicit waiver, before downstream work proceeds.
- Use Case: A research quest needs to compare a new method against a published model. The Skill reads the source paper and repo, sets up the environment with uv, runs a bounded smoke test then the real baseline run via bash_exec, verifies the metrics against the paper, and confirms the baseline for the experiment stage.
Quick Start
Ask the agent to establish and verify a baseline for the current quest by reproducing the specified paper's repository and confirming the comparison metrics.