research-experiment-engineering

Plans and implements reproducible research experiment code with configs, metrics, and run registries.

2|Updated May 22, 2026
One-click install
npx skills add https://github.com/CDUTAKL/research-workflow-kit --skill research-experiment-engineering-cdutakl
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: research-experiment-engineering
Source: https://github.com/CDUTAKL/research-workflow-kit/tree/main/skills/research-experiment-engineering
Command: npx skills add https://github.com/CDUTAKL/research-workflow-kit --skill research-experiment-engineering-cdutakl

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Research experiments often fail to produce trustworthy results because code architecture, configs, seeds, and outputs are not recorded consistently. This Skill turns a paper claim or experiment idea into a structured code architecture, run conventions, and thesis-console records so every run can be traced, reproduced, and mapped to a claim. ## Core Features & Use Cases - Experiment Architecture Planning: Separates data pipelines, model/algorithm modules, training, evaluation, metrics, and reporting with explicit contracts and boundary rules. - Run and Reproducibility Conventions: Defines stable experiment IDs, config/output directory layouts, machine-readable metrics, environment snapshots, and reproducibility status labels. - Multi-Target Execution Strategy: Coordinates local Mac smoke tests, a remote RTX 4060 desktop as the primary GPU target, and AutoDL cloud as a fallback with auto-save evidence and automatic shutdown. - Use Case: A graduate student needs to implement a baseline and ablation for a thesis claim. The Skill produces the module layout, config files, train/evaluate commands, an experiment registry row, and a remote GPU runbook before any training starts. ## Quick Start Use the research-experiment-engineering skill to plan the code architecture and runbook for my next thesis experiment.

Frequently Asked Questions about research-experiment-engineering

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I structure a reproducible machine learning experiment?

Separate data, model, training, evaluation, and metrics code into distinct modules, then give every run a stable experiment ID with its own output directory containing config_resolved.json, metrics.json, logs, and checkpoints. Record seed, split, and command in an experiment registry.

How to run deep learning experiments on a remote GPU over SSH?

Run a local CPU smoke test first, then sync code and configs to the remote machine via SSH, launch training in tmux or nohup, and save an environment snapshot. Record remote paths, artifact URIs, and checksums, and fetch only lightweight result indexes back locally.

Should I use Hydra, MLflow, or DVC for experiment tracking?

Plain JSON/YAML configs with stable output directories are the default and sufficient for most projects. Add Hydra, MLflow, DVC, or W&B only when the project already uses them or they remove real friction such as sweeps or hosted dashboards.

What should an experiment run record include for reproducibility?

Record the experiment ID, exact command, config path, random seed, data split rule, code version, environment, metric definitions, output and checkpoint paths, and execution target. Missing any of these downgrades the run to needs_rerun or not_reproducible status.

How do I prevent cloud GPU instances from billing after training finishes?

Use an auto-shutdown run wrapper that writes train.log, exit_code.txt, a run summary JSON, checksums, and an archive, then calls shutdown automatically. Verify the shutdown status before marking the run as reviewed.