analyze-results

Analyze ML experiment results and generate comparison tables with statistical insights.

75|7|Updated May 2, 2026
One-click install
npx skills add https://github.com/zjunlp/Mechanist --skill analyze-results-zjunlp
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: analyze-results
Source: https://github.com/zjunlp/Mechanist/tree/main/skills/analyze-results
Command: npx skills add https://github.com/zjunlp/Mechanist --skill analyze-results-zjunlp

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Interpreting raw experiment outputs scattered across JSON and CSV files is tedious and error-prone, especially when comparing runs across models, hyperparameters, and seeds. This Skill automates the analysis workflow so researchers get structured findings instead of manual spreadsheet work. ## Core Features & Use Cases - Result Aggregation: Locates and parses JSON/CSV result files from figures/, results/, or project output directories into structured data. - Comparison Tables: Organizes results by independent variables (model type, hyperparameters, data config) and dependent metrics, always computing delta versus baseline. - Statistical Analysis: Reports mean and standard deviation across seeds, identifies parameter sweep trends, and flags outliers or suspicious results. - Use Case: After running a hyperparameter sweep with three random seeds, ask the Skill to analyze the results directory and receive a comparison table, key findings with interpretations, and suggested follow-up experiments. ## Quick Start Ask the assistant to analyze the experiment results in the results directory and compare them against the baseline.

Frequently Asked Questions about analyze-results

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze ML experiment results across multiple runs?

Point the Skill at your results directory and it locates all JSON and CSV result files, parses them into structured data, and builds a comparison table organized by model type, hyperparameters, and metrics with deltas versus baseline.

How to compare experiment results with multiple random seeds?

The Skill reports mean plus or minus standard deviation across seeds to check reproducibility. It flags high-variance results and outliers so you can distinguish genuine effects from seed noise.

What output format does the results analysis produce?

Output always includes a raw data table, numbered key findings with observation, interpretation, implication, and next step, plus suggested follow-up experiments. Significant findings can be drafted into project documentation updates.

Can it detect trends in hyperparameter sweeps?

Yes, when results sweep a parameter the Skill identifies trend shapes such as monotonic, U-shaped, or plateau behavior. It also flags suspicious or outlier data points that may indicate bugs or misconfigured runs.

What file formats does the results analysis support?

The Skill parses JSON and CSV result files, searching standard output locations like figures/ and results/ directories as well as project-specific output paths. Other formats would need conversion to JSON or CSV first.