auto

Automate iterative code optimization loops with structured JSON experiment results.

3|2|Updated Mar 13, 2026
One-click install
npx skills add https://github.com/yoonhwan/ai-feature-pack --skill auto-yoonhwan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: auto
Source: https://github.com/yoonhwan/ai-feature-pack/tree/main/feature-pack/auto/skill
Command: npx skills add https://github.com/yoonhwan/ai-feature-pack --skill auto-yoonhwan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Manual code optimization via trial and error requires constant manual test execution, result tracking, and change rollback, which is slow and prone to human error. This skill automates the entire experiment loop so agents can focus solely on code modifications while all infrastructure and evaluation tasks are handled automatically.

Core Features & Use Cases

  • Karpathy AutoResearch Pattern: Enforces a strict agent role limited to code changes, eliminating accidental infrastructure modifications or manual test runs
  • Git-Based Experiment Tracking: Uses dedicated branches for each experiment, with automatic keep/discard/crash verdicts and full result logging to a TSV file
  • Autonomous Iteration: Runs continuous experiment loops, parses structured JSON results, and iterates on code changes without user intervention until predefined goals are met
  • Use Case: Optimize a speech-to-text model's character error rate, tune machine learning hyperparameters, or improve algorithm performance with minimal manual overhead

Quick Start

Use the auto skill to run a 2 hour autonomous experiment loop to optimize the character error rate of the local speech-to-text project.

Frequently Asked Questions about auto

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate iterative code optimization and ML model tuning?

Automating iterative code optimization requires an autonomous experiment loop that executes tests, parses structured JSON results, and applies code changes without manual intervention. This skill automates this workflow, handling test execution, result tracking, and change rollback automatically.

What is the Karpathy AutoResearch pattern for autonomous experiments?

The Karpathy AutoResearch pattern enforces a strict agent role limited exclusively to code modifications, eliminating accidental infrastructure changes or manual test runs. This ensures the agent focuses solely on code changes while all evaluation tasks are handled automatically.

How do I track machine learning experiments automatically using git branches?

Tracking machine learning experiments automatically using git branches involves dedicating a branch to each experiment, executing the runner, and logging keep, discard, or crash verdicts to a TSV file. This skill handles this git-based experiment tracking automatically.

Do I need a specific Python environment to run autonomous experiment loops?

Running autonomous experiment loops requires a uv-managed Python environment, a project-specific experiment runner that outputs structured JSON results, and a goal declaration file. These prerequisites ensure the agent can execute and evaluate iterations continuously.

What is the best way to run a long autonomous experiment loop for algorithm performance improvement?

Running a long autonomous experiment loop for algorithm performance involves setting a predefined quantitative goal and allowing the agent to iterate continuously on code changes. This skill automates the entire loop, parsing results and rolling back changes until the goal is met.

Why should I use automated git-based experiment tracking instead of manual trial and error?

Automated git-based experiment tracking eliminates the slow, error-prone manual tasks of executing tests, tracking results, and rolling back changes during code optimization. It allows agents to focus solely on code modifications while infrastructure and evaluation are handled automatically.