experiment-plan

Generates claim-driven experiment roadmaps with ablation matrices, run orders, and compute budgets for research papers.

Updated Apr 1, 2026
One-click install
npx skills add https://github.com/zniihgnexy/vid_tokenizer --skill experiment-plan-zniihgnexy
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: experiment-plan
Source: https://github.com/zniihgnexy/vid_tokenizer/tree/main/.claude/skills/experiment-plan
Command: npx skills add https://github.com/zniihgnexy/vid_tokenizer --skill experiment-plan-zniihgnexy

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Turning a refined research proposal into a concrete, paper-defensible experiment plan is hard: researchers often produce bloated benchmark wishlists instead of a focused claim-to-evidence roadmap. This Skill converts a method idea into a structured plan that maps every experiment to a paper claim, orders runs by milestone, and separates must-run evidence from nice-to-have extras. ## Core Features & Use Cases - Claim Map Construction: Freezes primary and supporting claims, anti-claims to rule out, and the minimum convincing evidence a strong reviewer would need. - Experiment Block Specification: Defines each block with dataset, baselines, metrics, setup details, success criteria, failure interpretation, and target table or figure, covering novelty isolation, simplicity checks, and frontier-model necessity checks. - Execution Ordering and Tracking: Produces a milestone-based run order with compute cost, decision gates, and risks, writing EXPERIMENT_PLAN.md and EXPERIMENT_TRACKER.md under refine-logs/. - Use Case: After refining a VLM-based compression method, ask for an experiment plan and receive a compact roadmap with three must-run blocks, a 3-seed ablation matrix, GPU-hour budget, and the first three runs to launch. ## Quick Start Ask the AI to create a detailed experiment plan for your refined research proposal, including ablations, baselines, run order, and compute budget.

Frequently Asked Questions about experiment-plan

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design an experiment plan for a research paper?▼

Start by freezing the paper's primary and supporting claims, then design experiment blocks that each defend one claim with datasets, baselines, metrics, and success criteria. This Skill automates that process and writes a structured EXPERIMENT_PLAN.md with run order and compute budget.

What experiments should I run to defend a novel ML method?▼

Run a main anchor result, a novelty isolation ablation, a simplicity check against an overbuilt variant, and a frontier necessity check if an LLM, VLM, Diffusion, or RL component is central. Prefer a few strong baselines over many weak ones.

How many baselines and seeds should an ablation study use?▼

The plan defaults to at most three baseline families and three seeds when stochastic variance matters and budget allows. A short, credible comparison set is preferred over a padded baseline list.

Can I use this without a prior research refinement step?▼

Yes. If refine-logs files like FINAL_PROPOSAL.md do not exist, the Skill derives the problem anchor, contributions, constraints, and reviewer concerns directly from your prompt instead.

What are the limitations of an automated experiment plan?▼

The plan defines evidence to collect but does not fabricate or guarantee results. Compute estimates and decision gates depend on the accuracy of the constraints you provide, and actual runs require a separate execution step.