What problem does it solve?
This Skill prevents guesswork by running an iterative change-measure-validate loop that keeps only improvements and automatically reverts regressions.
Core Features & Use Cases
- Ratchet-based optimization loop: proposes changes, measures a single target metric, and keeps/discards using a ratchet pattern with strict tie handling.
- Futility stopping and resume support: stops after consecutive unproductive iterations and can resume from existing JSONL results.
- Git-safe experimental workflow: enforces a dedicated worktree/branch discipline, commits changes, and reverts on discard to maintain a clean lab notebook trail.
- JSONL experiment logging: records iteration outcomes (including skips, correctness gate results, and reasons) in a structured
results.jsonl.
Quick Start
Tell your PI: use research-lab:experiment with a methodology file, a dedicated worktree path (not main), and the measurement harness to iteratively improve your chosen metric and log all results to results.jsonl.