ablation-planner

Ablation studies isolate component contributions by planning systematic removals or replacements of specific model parts. This skill generates a structured plan outlining hyperparameter sweeps, evaluation metrics, and a prioritized run order to validate your research claims.

Planning ablation experiments under budget constraints requires prioritizing component removals by feasibility and importance. This skill evaluates each proposed test's priority and expected outcomes, enabling you to execute high-value validation runs first.

Anticipating reviewer feedback during experimental design involves evaluating your ablation plan from a reviewer's perspective. A secondary agent assesses the proposed component isolations and hyperparameter sweeps, while a local executor reviews their implementation feasibility.

An experiment log for ablation tracking should record what-to-change, expected outcomes, and actual results. This skill enforces structured experiment logging to ensure every component removal, replacement, and hyperparameter test is systematically documented.

Yes, you can use this ablation planner for hyperparameter sweeps alongside component removals. It designs comprehensive validation plans that combine component isolations with hyperparameter tests, outlining a structured run order and evaluation metrics for both.

Limitations in planning component ablations stem from local execution feasibility constraints. The proposed component removals and replacements must be technically implementable by your local executor, meaning highly complex or deeply integrated model parts may require adjusted evaluation metrics.