massgen-log-analyzer

Run MassGen experiments and generate ANALYSIS_REPORT.md from traces.

1.1k|171|Updated Jul 18, 2025
One-click install
npx skills add https://github.com/massgen/MassGen --skill massgen-log-analyzer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: massgen-log-analyzer
Source: https://github.com/massgen/MassGen/tree/main/massgen/skills/massgen-log-analyzer
Command: npx skills add https://github.com/massgen/MassGen --skill massgen-log-analyzer

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides a structured workflow to run MassGen experiments and systematically analyze resulting traces and logs using instrumentation, coordination reports, and automated analysis reports.

Core Features & Use Cases

  • Automated Experiment Orchestration: Run MassGen experiments with proper instrumentation and collect traces for analysis.
  • Hierarchical Trace Analysis: Query and analyze coordination events, agent rounds, and decisions to diagnose performance and reliability.
  • Generate ANALYSIS_REPORT.md: Produce a markdown analysis report saved in the log directory for each turn.
  • Use Case: Ideal for debugging agent behavior, evaluating coordination patterns, and improving logging structure.

Quick Start

  1. Run MassGen experiments with observability: uv run massgen --automation --logfire --config [config_file] "[prompt]"
  2. After completion, locate the per-turn analysis report: [log_dir]/turn_1/ANALYSIS_REPORT.md
  3. If you want to reanalyze, run: uv run massgen logs analyze --turn 1

Frequently Asked Questions about massgen-log-analyzer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze MassGen agent logs and traces to debug behavior?

To analyze MassGen agent logs, run experiments with observability and Logfire integration enabled. This collects coordination traces and automatically generates an ANALYSIS_REPORT.md file in each turn's log directory for debugging behavior.

What is the best way to automate MassGen experiments with log analysis?

The best way to automate MassGen experiments is using the built-in automation flag with Logfire enabled. This orchestrates the runs, collects hierarchical traces, and produces reusable markdown analysis reports end-to-end.

How does MassGen log analysis work with Logfire integration?

MassGen log analysis works with Logfire by collecting instrumentation traces during automated experiment runs. It queries coordination events and agent rounds to diagnose performance and generate structured analysis reports.

Do I need Logfire to generate analysis reports for MassGen experiments?

Yes, you need Logfire integration enabled to collect the traces required for systematic analysis. MassGen uses this observability data to evaluate coordination patterns and generate the final analysis report.

Can I reanalyze a specific MassGen experiment turn after it finishes?

Yes, you can reanalyze a specific turn by running the logs analyze command with the target turn number. This regenerates the analysis report for that turn using the previously collected trace data.

Why are my MassGen coordination reports missing performance insights?

Coordination reports may lack performance insights if experiments are run without observability and Logfire integration. Enabling these features ensures hierarchical trace analysis captures agent decisions for the report.