star-expt-analyst

Audit AI experiment runs by verifying artifacts, logs, and metrics against plan criteria.

39|Updated Jul 15, 2026
One-click install
npx skills add https://github.com/wanghao9610/STAR --skill star-expt-analyst
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: star-expt-analyst
Source: https://github.com/wanghao9610/STAR/tree/main/.cursor/skills/star-expt-analyst
Command: npx skills add https://github.com/wanghao9610/STAR --skill star-expt-analyst

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) and assets (resource) components.

What problem does it solve?

This Skill solves the problem of inconsistent and unverified experiment reporting by providing a systematic, evidence-backed audit of research runs against their defined plans and done-criteria.

Core Features & Use Cases

  • Evidence-Based Auditing: Automatically verifies metrics and deliverables against the plan's §4 and §5 requirements by re-opening cited source files.
  • Log Health Monitoring: Scans logs for fatal signals like OOM, NaN, or divergence without loading massive files into memory.
  • Cross-Run Aggregation: Compiles verified results across multiple experiment runs into a structured table for paper-ready analysis.
  • Use Case: Use this after a training run to confirm if the model met its target accuracy, verify that all artifacts were generated, and generate a persistent analysis report in the project directory.

Quick Start

Use the star-expt-analyst skill to audit the latest experiment run for the current plan.

Frequently Asked Questions about star-expt-analyst

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit experiment results against a research plan?

Auditing experiment results involves verifying artifacts, log health, and performance metrics against defined plan criteria. This systematic research workflow provides reproducible validation and evidence-backed reporting without modifying source files.

How do I scan training logs for fatal signals like OOM or NaN?

Scanning logs for fatal signals like OOM, NaN, or divergence is done by monitoring log health without loading massive files into memory. This process identifies training instabilities and provides structured results aggregation for analysis.

Can I compare metrics across multiple experiment runs for paper-ready analysis?

Yes, you can compile verified results across multiple experiment runs into a structured table for paper-ready analysis. This cross-run aggregation compares performance metrics against defined done-criteria to ensure reproducible validation.

What is evidence-based auditing in AI research workflows?

Evidence-based auditing in AI research automatically verifies metrics and deliverables against plan requirements by re-opening cited source files. It solves inconsistent experiment reporting by providing systematic, reproducible validation of training runs.

Does the experiment audit process modify my source files?

No, the experiment audit process does not modify source files. It performs read-only verification of artifacts and performance metrics, generating a persistent analysis report in the project directory instead of altering original data.