result-to-claim

Evaluate experiment results against research claims and route next steps.

Updated Apr 29, 2026
One-click install
npx skills add https://github.com/jkfee/Auto-Research --skill result-to-claim-jkfee
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: result-to-claim
Source: https://github.com/jkfee/Auto-Research/tree/main/skills/result-to-claim
Command: npx skills add https://github.com/jkfee/Auto-Research --skill result-to-claim-jkfee

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Experiments produce numbers; this gate decides what those numbers mean and helps determine whether results support the intended claims, identify gaps, and decide next actions before writing papers or running ablations.

Core Features & Use Cases

  • Collect results from available sources: WandB (wandb.Api().run("<entity>/<project>/<run_id>").history()), EXPERIMENT_LOG.md, EXPERIMENT_TRACKER.md, log files, and docs/research_contract.md.
  • Codex Judgment: Send the collected results to Codex for objective evaluation and obtain a verdict with structured fields, then route to next steps (pivot, supplement, or confirm).
  • Step-wise workflow: parse results, check experiment integrity if an audit exists, and update project notes or research wiki as applicable.

Quick Start

Feed your completed experiment results into Codex for evaluation and routing.

Frequently Asked Questions about result-to-claim

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate if my experiment results support my research claims?

To evaluate if experiment results support research claims, this skill collects data from wandb, EXPERIMENT_LOG.md, and log files to generate a structured verdict. It identifies supported claims, missing evidence, and suggests claim revisions.

What is the best way to route next steps after analyzing experiment data?

The best way to route next steps after analyzing experiment data is by using a normalized Codex verdict. It routes your project to pivot, supplement, or confirm actions based on whether results provide no, partial, or full support.

Can I use wandb run history to check experiment integrity before writing papers?

Yes, you can use wandb run history to check experiment integrity before writing papers. The skill parses wandb data and EXPERIMENT_AUDIT.json to provide a confidence score and integrity status for your research contract.

How do I identify missing evidence and suggest claim revisions from research contracts?

To identify missing evidence and suggest claim revisions from research contracts, the skill compares results against docs/research_contract.md. It outputs specific fields detailing what results do not support and what next experiments are needed.

Does this workflow record reasoning for why experiment results do not support claims?

Yes, this workflow records reasoning for why experiment results do not support claims. It documents the detailed evaluation logic and routing decisions directly into findings.md for future reference.