autoresearch

Automates ML experiments by iteratively modifying train.py and committing git-ratcheted improvements.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/TheBoomerDev/feedback_proyect --skill autoresearch-theboomerdev
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: autoresearch
Source: https://github.com/TheBoomerDev/feedback_proyect/tree/main/.agents/skills/autoresearch
Command: npx skills add https://github.com/TheBoomerDev/feedback_proyect --skill autoresearch-theboomerdev

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Autonomous ML experimentation framework that enables an AI agent to iteratively modify train.py, run fixed 5-minute GPU experiments, and commit only improvements via git ratcheting — so you wake up to 100+ experiments and a better model.

Core Features & Use Cases

  • AI-driven loop reads directives, patches train.py, executes an experiment, and logs results for traceability.
  • Reproducible research with git ratcheting and a persistent results.tsv log.
  • Overnight experimentation on single-GPU machines with a strict time budget.

Quick Start

Update program.md with precise directives and run the autonomous loop to begin overnight experiments.

Frequently Asked Questions about autoresearch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate ML experiments to run overnight on a single GPU?

To automate ML experiments overnight, you can use an autonomous loop that iteratively patches train.py, executes fixed 5-minute GPU runs, and logs results. This enables continuous architecture exploration and hyperparameter tuning while you sleep.

What is git ratcheting for reproducible machine learning research?

Git ratcheting for reproducible machine learning is a workflow that commits only experimental improvements to train.py. It preserves a monotonic history of successful changes, ensuring traceability and reproducibility of your autonomous ML research results.

How do I set up an autonomous experiment loop for hyperparameter tuning?

To set up an autonomous experiment loop, you need a locked evaluation harness in prepare.py and precise directives in program.md. Running the loop then patches train.py, executes time-budgeted experiments, and logs outcomes to a persistent results.tsv file.

Can I run autonomous architecture exploration with a strict time budget per experiment?

Yes, autonomous architecture exploration can run with a strict time budget by executing fixed 5-minute GPU experiments. The AI-driven loop patches your training script, evaluates the modification, and only commits changes that yield improvements.

How does an autonomous ML agent decide which training script changes to keep?

An autonomous ML agent decides which training script changes to keep by evaluating each 5-minute GPU run against a locked evaluation harness. It uses git ratcheting to commit only modifications that produce measurable improvements, discarding unsuccessful patches.

What are the limitations of running autonomous ML experimentation on a single-GPU machine?

Running autonomous ML experimentation on a single-GPU machine limits you to sequential, fixed 5-minute experiments rather than parallel runs. It is designed for overnight research and requires a locked evaluation harness to ensure valid, reproducible comparisons across iterations.