autoresearch

Modify machine learning training code and evaluate models in a keep/discard loop.

Updated Mar 23, 2026
One-click install
npx skills add https://github.com/chrishuffman5/skills --skill autoresearch-chrishuffman5
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: autoresearch
Source: https://github.com/chrishuffman5/skills/tree/main/autoresearch
Command: npx skills add https://github.com/chrishuffman5/skills --skill autoresearch-chrishuffman5

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

Autoresearch solves the problem of manual experimentation and optimization in machine learning training. It allows you to run autonomous research experiments that modify training code, train models, evaluate results, and iterate — all without human intervention.

Core Features & Use Cases

  • Autonomous ML Research: Modify training code, train models, evaluate results, and iterate automatically.
  • Keep/Discard Loop: An experimental loop that keeps changes if they improve model performance, otherwise discards them.
  • Integration with Claude Code: Uses Claude Code's /loop feature for hands-off experimentation.

Quick Start

Use Claude Code's /loop feature to start an autonomous research experiment:

/loop 7m run the next autoresearch experiment — check results.tsv for history, modify train.py with a new idea, train, evaluate, keep or discard, log to results.tsv

Frequently Asked Questions about autoresearch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate machine learning experiments to optimize model training code?

You can automate machine learning experiments by using an autonomous loop that modifies training code, trains models, evaluates results, and keeps or discards changes based on performance metrics.

How does the keep or discard loop work for autonomous ML research?

The keep or discard loop evaluates model training results after each autonomous code modification, keeping changes only if they improve model performance and discarding them otherwise to iteratively optimize training.

Can I run autonomous ML research without manual intervention using Claude Code?

Yes, you can run autonomous ML research without manual intervention by integrating with Claude Code's /loop feature to continuously execute experimental cycles of modifying code, training, and evaluating models.

What do I need to set up before starting autonomous model optimization experiments?

You need a train.py file for model training code and a results.tsv file to log experiment history before starting the autonomous model optimization loop to track modifications and outcomes.

Is automated code modification effective for model optimization compared to manual tuning?

Automated code modification provides effective model optimization by autonomously applying new training ideas and validating them through a keep or discard loop, reducing manual experimentation overhead.

What are the limitations of using autonomous experimentation for machine learning training?

Autonomous experimentation limitations include dependency on the initial training code quality and the need for reliable evaluation metrics to accurately decide whether to keep or discard model training modifications.