autoresearch-mlx

Runs controlled training experiments on a NumPy character model with reproducible measurements.

465|41|Updated Aug 4, 2026
One-click install
npx skills add https://github.com/autonomous-ai/openharness --skill autoresearch-mlx-autonomous-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: autoresearch-mlx
Source: https://github.com/autonomous-ai/openharness/tree/main/store/agents/autoresearch-mlx/skills/autoresearch-mlx
Command: npx skills add https://github.com/autonomous-ai/openharness --skill autoresearch-mlx-autonomous-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires numpy.

What problem does it solve? It gives researchers a structured way to create and inspect science projects in the autoresearch-mlx Harness workspace, running controlled training experiments where every result is measured, versioned, and reproducible instead of relying on ad-hoc manual runs. ## Core Features & Use Cases - Controlled experiment runs: Read studio.json controls, change one training variable at a time, and execute runs via the toolchain's train command with documented parameter ranges. - Measured, reproducible results: Each run stores artifacts, evaluation.json, learning.csv, and the saved model under out/runs/<id>/, with data hashes defining which runs are comparable. - Local starter plus upstream MLX integration: Train a NumPy character transition model on CPU as a baseline, or prepare an Apple Silicon workspace for upstream MLX transformer training. - Use Case: A researcher tweaks a training hyperparameter, runs the experiment across several seeds, compares held-out cross-entropy against the saved baseline, and reports which run contains the verified result. ## Quick Start Ask the agent to read studio.json, run a baseline training with the toolchain train command, and report the measured result from the latest run.

Frequently Asked Questions about autoresearch-mlx

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run a controlled training experiment with autoresearch-mlx?

Read studio.json for the current controls, save a baseline run, change one training choice or the editable training code, then run the toolchain train command. Inspect evaluation.json, learning.csv, and the saved model in out/runs/<id>/ to compare against the baseline.

What does the local starter model actually train?

The local starter trains a small character transition model with NumPy on a bundled original text corpus. It uses real training with held-out cross-entropy as the metric, running on CPU as a baseline distinct from upstream MLX transformer training.

Can I use MLX transformer training with this workspace?

Yes, but upstream MLX training requires Apple Silicon and its prepared dataset. Read the upstream program.md and README.md, prepare a separate mlx/ workspace checkout with its environment and data, and note that its bits-per-byte metric differs from the starter's bits-per-character score.

How are experiment runs compared for reproducibility?

Data hashes define which earlier runs are comparable, and the runner independently reopens each saved model with pickle disabled to compute its score. Repeat promising changes with several seeds before drawing conclusions, and keep the holdout set unchanged.

What happens when a training run fails?

A failed run preserves the last successful result and records the error in the verdict. The out/latest.json file continues to name the current successful result, so prior work is not lost.