analyze-results

Aggregate ML experiment metrics and generate statistical comparison reports.

Updated Apr 8, 2026
One-click install
npx skills add https://github.com/KYRIE66nb/codex-omx-public-config --skill analyze-results-kyrie66nb
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: analyze-results
Source: https://github.com/KYRIE66nb/codex-omx-public-config/tree/main/home/.codex/skills/analyze-results
Command: npx skills add https://github.com/KYRIE66nb/codex-omx-public-config --skill analyze-results-kyrie66nb

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates the analysis of ML experiment results, computing statistics, building comparison tables, and deriving actionable insights to speed up research decisions.

Core Features & Use Cases

  • Automated result consolidation: gather results from common directories like figures/ or results/ and normalize into a structured dataset.
  • Statistical analysis and summaries: compute mean, std, delta vs baseline, and flag anomalies across seeds and parameter sweeps.
  • Insight generation and reporting: produce concise observations, interpretations, and recommended next steps, plus updated docs or experiment notes.
  • Use Case: You have multiple model runs saved in various formats; the skill aggregates metrics, shows trends, and highlights significant improvements or regressions.

Quick Start

Identify all experiment outputs in figures/ or results/, compute key metrics, and generate a concise findings report.

Frequently Asked Questions about analyze-results

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze ML experiment results across multiple seeds and parameter sweeps?

To analyze ML experiment results, this skill aggregates metrics from common output directories, normalizes the data, and computes statistical summaries including mean, standard deviation, and delta versus baseline across multiple seeds and parameter sweeps.

What is the best way to consolidate machine learning model runs from figures and results directories?

Consolidating machine learning model runs involves gathering outputs from directories like figures/ or results/, normalizing them into a structured dataset, and generating comparative trends to highlight significant improvements or regressions.

How do I generate a statistical report comparing ML hyperparameter sweep outputs?

Generating a statistical report for ML hyperparameter sweep outputs requires aggregating metrics, computing statistical summaries to flag anomalies, and producing an insights section with observations and recommended next steps suitable for documentation.

Can I use this to find baseline improvements and regressions in machine learning experiments?

Yes, you can use this to find baseline improvements and regressions by computing delta versus baseline metrics, building comparison tables, and automatically surfacing concise observations about significant trends in your machine learning experiments.

What statistics are computed when analyzing machine learning experiment outputs?

When analyzing machine learning experiment outputs, the statistics computed include mean, standard deviation, and delta versus baseline, alongside anomaly flagging across various runs and seeds to derive actionable insights for research decisions.

Does this approach require specific frameworks to aggregate ML model metrics?

No specific frameworks are required to aggregate ML model metrics; the approach identifies experiment outputs saved in common directories like figures/ or results/, normalizes the diverse formats into a structured dataset, and automatically computes comparative trends.