ablation-planner

Generates reviewer-focused ablation studies with prioritized execution plans and compute-aware run order.

Updated Apr 21, 2026
One-click install
npx skills add https://github.com/Shallow-W/llm-wiki --skill ablation-planner-shallow-w
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ablation-planner
Source: https://github.com/Shallow-W/llm-wiki/tree/main/.claude/skills/ablation-planner
Command: npx skills add https://github.com/Shallow-W/llm-wiki --skill ablation-planner-shallow-w

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Ablation experiments often fail to convince reviewers because they do not directly test each claimed contribution, compare against plausible alternatives, or reveal sensitivity to key design choices.

Core Features & Use Cases

  • Reviewer-perspective ablations: Designs component removals/replacements and alternative designs that map to specific reviewer questions.
  • Evidence-driven planning: Uses your method description, current results, and claims to determine what to test and what to skip.
  • Feasibility-aware execution plan: Guides implementation steps, compute-aware prioritization, and run order suitable for paper timelines.
  • Structured output normalization: Converts a proposed plan into component, hyperparameter, comparisons, coverage assessment, and estimated compute.

Example: If your main results support your claims only partially and you need ablations for a submission, this Skill produces a prioritized ablation suite that isolates each novel component and tests sensitivity to key hyperparameters.

Quick Start

Ask the skill to create an ablation plan for your current method and experimental results, explicitly stating your claims, what is already covered by existing experiments, and your compute constraints.

Frequently Asked Questions about ablation-planner

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design ablation studies that address reviewer feedback?

To design reviewer-proof ablation studies, you need an ablation plan that isolates each claimed component, tests hyperparameter sensitivity, and maps directly to specific reviewer questions using your method description and current results.

What is the best way to plan ML experiments for a paper submission?

Planning ML experiments for a paper submission requires generating a structured experimental suite that includes component ablations, design comparisons, coverage assessment, run order, and compute estimates to ensure your claims are fully supported.

How do I prioritize ablation experiments under tight compute constraints?

Prioritize ablation experiments under compute constraints by generating a feasibility-aware execution plan that assigns explicit priority levels to component removals and hyperparameter sweeps based on your available compute budget.

Do I need existing experimental results to create an ablation plan?

Yes, you need existing experimental results and a defined method description to create an ablation plan, because the planning process uses an evidence-driven approach to determine what claims are already covered and what sensitivity questions still need testing.

What components should an ablation study include to isolate machine learning contributions?

An ablation study to isolate machine learning contributions should include component ablations, hyperparameter sweeps, alternative design comparisons, and coverage assessment to test the sensitivity of each novel component against plausible alternatives.