What problem does it solve?
Autoresearch removes the manual grind of incremental performance or behavior tuning by running an autonomous loop that proposes changes, commits them, runs a user-defined metric command, measures results, and keeps or reverts changes based on objective outcomes. It ensures every experiment is measured, tracked, and reversible so humans don't have to manually try and evaluate many small modifications.
Core Features & Use Cases
- Interactive Setup: Guides the user to define a clear goal, the exact metric command and extraction method, in-scope/out-of-scope files, constraints, and experiment budget before any changes are made.
- Autonomous Experiment Loop: Creates a branch, commits each experiment, runs the metric command, extracts the metric, and either keeps or reverts the commit while logging results in results.tsv.
- Safety and Reproducibility: Uses git-based commits and reverts, avoids modifying out-of-scope files, and requires user approval for environment or dependency changes.
- Use Case Examples: Optimize benchmark timings, reduce memory usage, increase test pass rates, or minimize bundle size in codebases where a reproducible command yields a numeric metric.
Quick Start
Start an autonomous optimization run by telling the agent your goal, providing the exact metric command and extraction rule, listing which files are in-scope, and confirming the setup.