What problem does it solve?
Turn ad-hoc guesses and one-off tweaks into a systematic, never-ending experimentation pipeline that reliably finds measurable improvements for any metric-driven project. It removes the manual coordination burden of proposing, implementing, measuring, and deciding on changes so teams can continuously optimize performance, ads, code quality, ML training, or custom domains.
Core Features & Use Cases
- Continuous Experimentation Orchestration: Spawns a small agent team (researcher, executor, analyst) to propose experiments, implement changes in isolated worktrees, run reproducible measurements, and decide keep versus discard.
- Domain Templates & Measurement Contracts: Ships templates for ML training, web performance, ad optimization, code quality, and custom domains so experiments use domain-appropriate metrics and commands.
- Local Learning Layer: Optionally trains a tiny GPU-backed predictor from results history to prioritize high-probability proposals after sufficient experiments.
- Use Case: Automatically iterate on Lighthouse optimizations, A/B ad creatives, or small ML hyperparameter tweaks and record every experiment in results.tsv for auditability and model-driven prioritization.
Quick Start
Use the karpathy skill to start an autonomous experimentation loop that measures a baseline, proposes targeted changes, runs them in isolated branches, and reports keep/discard decisions.