What problem does it solve?
Experiment provides a structured, repeatable loop to test single-code changes, measure their impact, and keep or revert them based on numeric evidence, eliminating ad-hoc trial-and-error and ambiguous outcomes.
Core Features & Use Cases
- One-change-per-iteration workflow: spawn an isolated sub-agent for each hypothesis, implement a single change, and run a measurement to determine its effect.
- Progress tracking: use a progress.md file as the single source of truth for baseline, current best, iterations, and failed hypotheses.
- Asynchronous measurement support: integrate Monitor for long-running benchmarks or test suites and continue planning while measurements run.
- Use Cases: performance optimization, targeted refactoring, UI/UX A/B-style tweaks, and exploratory bug-fixing when the root cause is uncertain.
Quick Start
Start an experiment to reduce API latency by recording a baseline with a measurement command, iterating one change at a time, and updating progress.md with results.