autoresearch

Automate iterative ML research loops by modifying training code and evaluating metrics.

6|1|Updated Feb 20, 2026
One-click install
npx skills add https://github.com/aviskaar/open-org --skill autoresearch-aviskaar
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: autoresearch
Source: https://github.com/aviskaar/open-org/tree/main/skills/autoresearch
Command: npx skills add https://github.com/aviskaar/open-org --skill autoresearch-aviskaar

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates the process of iterating on machine learning model training, allowing for continuous improvement without manual intervention.

Core Features & Use Cases

  • Iterative Model Improvement: Automatically modifies training code, runs experiments, evaluates metrics, and keeps only beneficial changes.
  • Cross-Platform Support: Works across CUDA, Apple Silicon MPS, and CPU environments.
  • Use Case: Let an AI agent autonomously discover better model architectures or hyperparameters for your deep learning project overnight, reporting back with the best-performing configuration.

Quick Start

Use the autoresearch skill to autonomously run an ML research loop on train.py with a 5-minute time budget per experiment, optimizing for validation accuracy.

Frequently Asked Questions about autoresearch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate an iterative machine learning research loop to discover better model architectures?

Automating an iterative ML research loop involves automatically modifying training code, executing timed experiments, and evaluating a single metric to retain beneficial changes autonomously. You configure training script paths, time budgets, and optimization metrics to let the agent discover improved configurations.

Can I run autonomous hyperparameter tuning on Apple Silicon MPS or CPU environments?

Yes, autonomous hyperparameter tuning supports cross-platform execution across CUDA, Apple Silicon MPS, and CPU environments. You can run the automated experiment loop locally on your available hardware without requiring a dedicated GPU cluster.

How do I set up a time budget per experiment for autonomous model training?

Setting up a time budget per experiment requires configuring the iteration limits and time constraints in your training script execution settings. The automated loop executes each experiment within the specified time budget, evaluates the optimization metric, and retains only the improvements.

What is needed to start autonomous ML model architecture discovery overnight?

To start autonomous ML model architecture discovery, you need a configured training script path, a defined optimization metric, a time budget per experiment, and iteration limits. The loop runs continuously, modifying code and evaluating results to report the best-performing configuration.

Does the autonomous experiment loop modify my original training code directly?

Yes, the autonomous experiment loop modifies training code directly to iterate on model architectures and hyperparameters. It evaluates a single metric after each timed execution and keeps only the changes that result in beneficial improvements to your model.

What are the limitations of using an autonomous loop for deep learning research?

Limitations include relying on a single optimization metric for evaluation and requiring explicit configuration of iteration limits and time budgets. The loop's effectiveness is bounded by the specified time constraints and the quality of the initial training script provided.