autoconference:analyze

Analyze autoconference outputs to produce a structured analysis-report.md.

5|Updated Mar 18, 2026
One-click install
npx skills add https://github.com/wjgoarxiv/autoconference-skill --skill autoconference-analyze
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: autoconference:analyze
Source: https://github.com/wjgoarxiv/autoconference-skill/tree/main/skills/analyze
Command: npx skills add https://github.com/wjgoarxiv/autoconference-skill --skill autoconference-analyze

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you understand what happened during an autoconference, why certain researcher strategies succeeded or failed, and what transferable lessons you can apply to future runs.

Core Features & Use Cases

  • Trajectory comparison: Contrasts researcher performance (best metric, convergence speed, exploration breadth, success rate) against the conference baseline.
  • Failure mode analysis: Clusters reverted strategy attempts and summarizes peer-review challenges and overrules to reveal systematic issues.
  • Cross-researcher insight extraction: Audits knowledge transfer from poster sessions, tracks adoption, and measures metric impact.
  • Insight taxonomy + novelty assessment: Produces a structured set of actionable insights with confidence, transferability, and predictability scoring.

Use case: After completing an autoconference for a research goal, run this Skill to generate a full analysis-report.md that turns raw artifacts (TSV + round transcripts) into a decision-ready summary of what to keep, change, or avoid.

Quick Start

Use the autoconference:analyze skill to create an analysis report from a completed conference directory by specifying the conference folder that contains conference.md and conference_results.tsv.

Frequently Asked Questions about autoconference:analyze

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze multi-agent research conference results and extract failure modes?

To analyze multi-agent research conference results, you need a tool that reads conference artifacts like TSV histories and transcripts to compute trajectory metrics, cluster reverted strategies, and generate a structured failure mode analysis report.

What is knowledge transfer evaluation in multi-agent systems?

Knowledge transfer evaluation in multi-agent systems tracks the adoption of insights shared during poster sessions and measures their subsequent impact on research metrics across different agents over time.

How do I generate an insight taxonomy from conference TSV and transcript artifacts?

You can generate an insight taxonomy from conference TSV and transcript artifacts by processing all available run outputs to extract structured lessons, assessing each insight for confidence, transferability, and predictability.

Can I compare researcher trajectories using conference_results.tsv data?

Yes, you can compare researcher trajectories using conference_results.tsv data by contrasting individual performance metrics like convergence speed, exploration breadth, and success rate against the established conference baseline.

What files are required to run a post-run conference analysis?

To run a post-run conference analysis, your conference directory must contain at minimum the conference.md and conference_results.tsv files, while optional per-researcher TSV histories and peer review transcripts enhance the output.

How does clustering reverted strategy attempts improve research evaluation?

Clustering reverted strategy attempts improves research evaluation by grouping failed multi-agent approaches, summarizing peer-review challenges and overrules to reveal systematic issues rather than isolated errors.