mechinterp-summarizer

Convert ExperimentResult JSON into Markdown notes with optional hypothesis evidence linking.

1|Updated Jul 9, 2024
One-click install
npx skills add https://github.com/cesaregarza/SplatNLP --skill mechinterp-summarizer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: mechinterp-summarizer
Source: https://github.com/cesaregarza/SplatNLP/tree/main/.claude/skills/mechinterp-summarizer
Command: npx skills add https://github.com/cesaregarza/SplatNLP --skill mechinterp-summarizer

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Converts ExperimentResult JSON into Markdown notes and optionally links them to hypotheses in the research state.

Core Features & Use Cases

  • Converts ExperimentResult JSON into Markdown notes.
  • Extracts key findings, tables, and diagnostics.
  • Appends notes to feature-specific research files.
  • Optionally updates the research state with new evidence.
  • Synthesizes enhancer and suppressor patterns for complete interpretation.

Quick Start

Basic: Generate a note from a result cd /root/dev/SplatNLP poetry run python -m splatnlp.mechinterp.cli.summarizer_cli
--result-path /mnt/e/mechinterp_runs/results/20250607_142531__result.json

With state update and evidence linking poetry run python -m splatnlp.mechinterp.cli.summarizer_cli
--result-path /mnt/e/mechinterp_runs/results/20250607_142531__result.json
--update-state
--supports h001
--strength strong

Print only (no file writes) poetry run python -m splatnlp.mechinterp.cli.summarizer_cli
--result-path result.json
--output-only

Frequently Asked Questions about mechinterp-summarizer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert ExperimentResult JSON into Markdown research notes?

Converting ExperimentResult JSON into Markdown research notes involves parsing the result file to extract key findings, tables, and diagnostics, then generating human-readable notes appended to feature-specific research files.

How do I link experiment results to hypotheses in a research state?

Linking experiment results to hypotheses requires updating the research state with new evidence using a CLI, specifying the hypothesis identifier and evidence strength to connect the generated notes directly to existing research hypotheses.

Can I synthesize enhancer and suppressor patterns from mechinterp experiments?

Synthesizing enhancer and suppressor patterns from mechinterp experiments is supported by the summarizer, which extracts diagnostics from the ExperimentResult JSON to provide complete interpretation of the tested feature behaviors.

How do I print summarized experiment notes without writing to files?

Printing summarized experiment notes without writing to files is achieved by passing the output-only flag to the CLI, which generates the Markdown notes from the result JSON and outputs them directly to standard output.

Do I need any external dependencies to run the mechinterp experiment summarizer?

No external dependencies are required to run the mechinterp experiment summarizer, as it operates standalone using a CLI or programmatic interface to parse result JSON and generate Markdown documentation.