result-to-claim

Collect experiment results and route claim judgments via Codex MCP.

Updated Apr 26, 2026
One-click install
npx skills add https://github.com/jandan138/Auto-claude-code-research-in-sleep --skill result-to-claim-jandan138
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: result-to-claim
Source: https://github.com/jandan138/Auto-claude-code-research-in-sleep/tree/main/skills/result-to-claim
Command: npx skills add https://github.com/jandan138/Auto-claude-code-research-in-sleep --skill result-to-claim-jandan138

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Use when experiments complete to judge what claims the results support, what they don't, and what evidence is still missing. Codex MCP evaluates results against intended claims and routes to next action (pivot, supplement, or confirm). Use after experiments finish — before writing the paper or running ablations.

Core Features & Use Cases

  • Collect results from multiple sources (wandb, EXPERIMENT_LOG.md, EXPERIMENT_TRACKER.md, log files, docs/research_contract.md) and compile the key information about methods, datasets, configurations, and baselines.
  • Call Codex MCP to produce a structured judgment on whether the results support the intended claim, and to route to pivot, supplement, or confirm.
  • Output a normalized verdict and guidance for next steps (e.g., update claims, design follow-up experiments, or move toward paper drafting).

Quick Start

Run this gate after experiments finish to have Codex judge claim support and route to the next action.

Frequently Asked Questions about result-to-claim

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate experiment results against research claims?

To evaluate experiment results against research claims, collect methods, datasets, and baselines from sources like wandb and log files, then use Codex MCP to objectively judge claim support and route next actions.

Can I use wandb logs to determine if my experiment supports a hypothesis?

Yes, you can use wandb logs to determine hypothesis support by collecting experiment data and sending it to Codex MCP, which judges whether the results support the intended claim and identifies missing evidence.

What is the best way to route next actions after experiments finish?

The best way to route next actions after experiments finish is to parse a structured verdict on claim support and confidence, determining whether to pivot, supplement with follow-up experiments, or confirm and move toward paper drafting.

How do I structure experiment data for claim evaluation?

To structure experiment data for claim evaluation, compile key information about methods, datasets, configurations, and baselines from EXPERIMENT_LOG.md and docs/research_contract.md into a normalized format for objective judgment.

When should I run a claim evaluation gate in my research workflow?

You should run a claim evaluation gate in your research workflow immediately after experiments finish and before writing the paper or running ablations, ensuring results objectively support the intended claims.

Does Codex MCP identify missing evidence in experiment results?

Yes, Codex MCP identifies missing evidence in experiment results by parsing a structured verdict into fields like what_results_dont_support, missing_evidence, and suggested_claim_revision to guide downstream actions.