setup-task

Generate causalab task packages from markdown specifications with validation.

108|37|Updated Apr 25, 2025
One-click install
npx skills add https://github.com/goodfire-ai/causalab --skill setup-task
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: setup-task
Source: https://github.com/goodfire-ai/causalab/tree/main/.claude/skills/setup-task
Command: npx skills add https://github.com/goodfire-ai/causalab --skill setup-task

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

The setup-task Skill turns a task specification into a complete, convention-compliant causalab/tasks/<task_name>/ package so you can immediately run causal abstraction experiments instead of wiring files by hand.

Core Features & Use Cases

  • Creates a full task package from an MD spec: Generates config.py, templates.py, causal model code, counterfactual generators, token position logic, checker, metrics, and a summary notebook.
  • Guides spec ingestion and clarification: Supports existing specs (MD), or interactive/PDF-driven spec creation with approval checkpoints.
  • Performs model validation wiring checks: Loads the specified model, validates end-to-end behavior, and verifies token alignment plus spacing-handling.

Quick Start

Run the skill by providing the path to your markdown task specification, for example: Invoke /setup-task path/to/task_spec.md and then confirm the extracted fields when prompted.

Frequently Asked Questions about setup-task

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a mechanistic interpretability task package from a markdown specification?

To create a mechanistic interpretability task package from a markdown specification, provide the MD file path to generate a complete folder with config, templates, causal models, and counterfactuals automatically. This ensures all generated files comply with causal task conventions.

What is causal abstraction task setup and when do I need it?

Causal abstraction task setup is the process of defining causal models, counterfactuals, and token alignment checks for interpretability experiments. You need it when exploring or investigating model behaviors to ensure inputs and outputs are consistent with the chosen model.

How do I validate token alignment and output checking for a causal task?

To validate token alignment and output checking for a causal task, the setup process loads the specified model and runs end-to-end validation. This verifies output token modes, variable naming conventions, and accuracy across the generated task modules.

Do I need an active research session to generate counterfactuals for interpretability experiments?

Yes, you need an active research session to generate counterfactuals for interpretability experiments. The task generation process requires an active session to properly wire causal models, enforce conventions, and run end-to-end model validation checks.

Can I use a PDF to create a causal task specification if I don't have a markdown file?

Yes, you can use a PDF to create a causal task specification if you lack a markdown file. The generation process supports interactive or PDF-driven spec creation with approval checkpoints to extract the necessary task fields.

What's the best way to ensure variable naming conventions are enforced in causal model code?

The best way to ensure variable naming conventions are enforced in causal model code is to generate the task modules from approved templates. This automatically enforces output token modes and standardizes variable names across the package.