report-research

Generate a publishable Numerai experiment report with results tables and plots.

Updated Feb 4, 2026
One-click install
npx skills add https://github.com/donzales12/example-scripts --skill report-research-donzales12
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: report-research
Source: https://github.com/donzales12/example-scripts/tree/main/numerai/agents/skills/report-research
Command: npx skills add https://github.com/donzales12/example-scripts --skill report-research-donzales12

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Consolidates Numerai experiment runs into a durable, publishable experiment report (experiment.md) that includes an abstract, methods, results tables, decisions, and next steps, and automatically links the standard show_experiment plot(s).

Core Features & Use Cases

  • Generate a complete experiment report from run artifacts (configs, results, predictions, experiment.md).
  • Inventory runs, identify best models using metrics such as corr_mean, bmc_mean, and bmc_last_200_eras.mean, and summarize per round with the included plots.
  • Create or update experiment.md with sections: Title, Abstract, Methods, Experiments run, Results, Standard plot, Decisions, Stopping rationale, Findings, Next experiments, and Repro commands.

Quick Start

Follow the instruction to generate or update the experiment.md report for a Numerai experiment and attach the standard show_experiment plot.

Frequently Asked Questions about report-research

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate a Numerai experiment report from run artifacts?

To generate a Numerai experiment report, you use run artifacts from the configs, results, and predictions directories to populate an experiment.md file with abstract, methods, results tables, and next steps.

What is the standard format for documenting Numerai data-science experiments?

The standard format for documenting Numerai experiments is a durable experiment.md file containing sections for Title, Abstract, Methods, Experiments run, Results, Standard plot, Decisions, Stopping rationale, Findings, Next experiments, and Repro commands.

Which metrics are required to summarize Numerai models in an experiment report?

The metrics required to summarize Numerai models in an experiment report include corr_mean, bmc_mean, bmc_last_200_eras.mean, and avg_corr_with_benchmark to identify best models and summarize per round.

Can I embed the show_experiment plot directly into my Numerai experiment.md file?

Yes, you can embed the standard show_experiment plot directly into your Numerai experiment.md file, as the report generation process automatically links and attaches these standard plots to summarize per round results.

Do I need prediction files to create a full write-up of a Numerai research experiment?

Yes, you need the experiment artifacts from the configs, results, and predictions directories, along with the generated metrics, to create a full write-up or generated plots for a Numerai research experiment.