ds-analysis-campaign

Orchestrates coordinated follow-up experiment campaigns for ablations, robustness checks, and error analysis.

1.1k|116|Updated Feb 26, 2026
One-click install
npx skills add https://github.com/OpenLAIR/dr-claw --skill ds-analysis-campaign
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ds-analysis-campaign
Source: https://github.com/OpenLAIR/dr-claw/tree/main/skills/ds-analysis-campaign
Command: npx skills add https://github.com/OpenLAIR/dr-claw --skill ds-analysis-campaign

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

After a main experiment produces a result, research quests often need structured follow-up runs such as ablations, robustness checks, sensitivity tests, or failure analysis. Without a disciplined protocol, these runs become an untracked pile of extra experiments with buried negative results and no clear connection back to the paper or claim they support.

Core Features & Use Cases

  • Structured Campaign Protocol: Launches each campaign with a durable decision artifact, a charter report, a PLAN.md, and a CHECKLIST.md so every slice is planned, tracked, and recorded.
  • Paper-Facing Slice Binding: Binds each analysis slice to a selected outline, a paper experiment matrix, and fields like section_id, claim_links, and paper_role so results map directly into manuscript sections.
  • Comparability and Honest Reporting: Enforces one question per run, fixed evaluation contracts, visible null and negative findings, and an aggregated report classifying outcomes as stable support, partial support, contradiction, or unresolved ambiguity.
  • Use Case: After a main experiment shows your method beats a baseline, use this Skill to run a claim-critical ablation, a seed-robustness check, and a failure-bucket analysis, then aggregate the evidence and route the quest to paper writing.

Quick Start

Run an analysis campaign on my main experiment with ablations for each core component and a robustness check across three random seeds, then summarize whether the main claim still holds.

Frequently Asked Questions about ds-analysis-campaign

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run ablation experiments after a main result?

Launch an analysis campaign that binds to the parent run, defines one research question per ablation slice, and records each slice as a run artifact. Claim-critical ablations run first, followed by robustness and sensitivity checks, then the campaign aggregates findings into a single report.

What is an analysis campaign in a research workflow?

An analysis campaign is a coordinated set of follow-up experiments such as ablations, robustness checks, error analysis, or efficiency measurements run after a main experiment. It tests the strength, boundaries, and failure modes of a result rather than producing a new main result.

When should I not use an analysis campaign?

Do not start a campaign when the quest lacks a credible main run or accepted baseline, or when the next step is clearly another main experiment rather than follow-up evidence work. Campaigns exist to strengthen or bound an existing claim, not to replace primary experiments.

How do analysis slices connect to paper writing?

For writing-facing campaigns, each slice maps to a row in the paper experiment matrix and carries section_id, item_id, claim_links, and paper_role fields. After each slice completes, the matrix, evidence ledger, and outline result tables are updated so the draft reflects the new evidence.

How are negative or failed experiment results handled?

Failed or infeasible slices are still recorded with an honest non-success status, the real blocker, and a next recommendation. Null and contradictory findings must remain visible in the aggregated report rather than being buried or silently skipped.