analysis-campaign

Orchestrates coordinated follow-up experiment campaigns for ablations, robustness checks, and failure analysis.

Updated Apr 1, 2026
One-click install
npx skills add https://github.com/zniihgnexy/vid_tokenizer --skill analysis-campaign-zniihgnexy
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: analysis-campaign
Source: https://github.com/zniihgnexy/vid_tokenizer/tree/main/.ds/codex-home/skills/deepscientist-analysis-campaign
Command: npx skills add https://github.com/zniihgnexy/vid_tokenizer --skill analysis-campaign-zniihgnexy

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? After a main experiment produces a result, research quests often need structured follow-up runs such as ablations, sensitivity checks, or error analysis. Without a disciplined protocol, these runs become an untracked pile of extra experiments with buried negative results and no clear conclusion. ## Core Features & Use Cases - Campaign Charter & Planning: Creates durable PLAN.md and CHECKLIST.md files that bind every analysis slice to a research question, hypothesis, and falsifiable expectation before any run launches. - Isolated Slice Execution: Splits the campaign into one-question-per-run slices with controlled variables, smoke tests for long runs, and managed bash_exec monitoring with stall detection. - Paper-Facing Integration: Maps each slice to a paper experiment matrix row with section_id, claim_links, and paper_role so completed evidence flows back into outlines and evidence ledgers. - Use Case: After a main training run shows a gain, use this Skill to run a claim-critical ablation first, then robustness checks across seeds, record each slice as a run artifact, and aggregate a report classifying the outcome as stable support, partial support, contradiction, or unresolved ambiguity. ## Quick Start Launch an analysis campaign for the accepted main run with one ablation slice and one robustness slice, then aggregate the results into a campaign report.

Frequently Asked Questions about analysis-campaign

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run ablation experiments after a main result?▼

Launch an analysis campaign that binds slices to the parent run, creates PLAN.md and CHECKLIST.md, and runs claim-critical ablations first. Each slice gets one research question, controlled variables, and a recorded run artifact with metrics and verdict.

What is an analysis campaign in a research workflow?▼

An analysis campaign is a coordinated set of follow-up runs such as ablations, robustness checks, and error analysis tied to one main claim. It enforces one question per run, comparability against the baseline, and explicit aggregation of stable versus contradictory findings.

When should I not use an analysis campaign?▼

Do not launch a campaign when the quest lacks a credible main run or accepted baseline, or when the next step is clearly another main experiment rather than follow-up evidence work. Campaigns test the strength and boundaries of an existing result.

How do analysis slices connect to a paper outline?▼

Writing-facing campaigns require a selected outline and a paper experiment matrix. Each slice carries section_id, item_id, claim_links, and paper_role fields, and completion updates the outline result_table and evidence ledger before the slice counts as paper-ready.

How are long-running experiment slices monitored?▼

Long slices run through bash_exec in detach mode after a bounded smoke test, with a wait cadence of 60s to 1800s between checks. Stall detection uses silent_seconds and watchdog signals, and wedged slices can be killed with session control.

What happens when an analysis slice fails or contradicts the claim?▼

Failed slices are still recorded with an honest non-success status, the real blocker, and a next recommendation. Contradictory findings must stay visible in the aggregated report, which classifies outcomes as stable support, partial support, contradiction, or unresolved ambiguity.