skills.rest
tmuskal
tmuskalCOMMUNITY
Explore all skills by this author →
𝕏@tmuskalGitHub

report

Generate LongMemEval benchmark reports in markdown, JSON, or summary formats.

3|1|Updated Apr 11, 2026
Search Tags:#benchmarking#report generation#scorecard#accuracy analysis#LongMemEval
One-click install
npx skills add https://github.com/tmuskal/arc-agi-benchmarker --skill report-tmuskal
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: report
Source: https://github.com/tmuskal/arc-agi-benchmarker/tree/main/plugins/longmemeval-benchmarker/skills/report
Command: npx skills add https://github.com/tmuskal/arc-agi-benchmarker --skill report-tmuskal

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill automatically generates a detailed performance report from completed LongMemEval runs, including overall and per-question-type accuracy.

Core Features & Use Cases

  • Generate Report: Automatically compute and produce a comprehensive scorecard from LongMemEval runs.
  • Customize Format: Output the report in various formats: markdown, JSON, or a summary.
  • Run Identification: Can be applied to a specific run ID or the latest one available.
  • Use Case: Imagine you have conducted several LongMemEval tests and need a detailed breakdown of the results for analysis or review. This Skill would compile all relevant information into a concise and actionable report.

Quick Start

Run the command /arc-agi-benchmarker:report latest to generate a scorecard from the latest LongMemEval run in markdown format.

Frequently Asked Questions about report

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate a scorecard from LongMemEval benchmark results?▼

Generate a LongMemEval scorecard by running the report command against your JSON-structured run data to automatically compute overall and per-question-type accuracy into a detailed scorecard.

Can I export LongMemEval accuracy analysis results in JSON format?▼

Yes, you can export LongMemEval accuracy analysis results in JSON format by customizing the output format setting to include markdown, JSON, or a summary during the report generation process.

What is the best way to analyze accuracy from a specific LongMemEval run?▼

To analyze accuracy from a specific LongMemEval run, provide the target run ID to the report generator to render detailed benchmark results for that particular test instead of the latest one.

Does the LongMemEval report generator require any external dependencies?▼

No, the LongMemEval report generator operates without external dependencies, using internal scripts to parse JSON-structured data and render benchmark scorecards directly within your environment.

What data format is needed to produce a LongMemEval performance report?▼

Producing a LongMemEval performance report requires JSON-structured data from completed benchmarking runs to accurately compute and render the overall and per-question-type accuracy metrics.

Related Skills

Explore More Data & Analytics Skills→
tmuskaltmuskal
3

compare-runs

Compare two LongMemEval runs by scorecards, harness configurations, and per-question-type accuracy.

Community
Intermediate
pluginagentmarketplacepluginagentmarketplace
3

red-team-reporting

Generate security assessment reports from structured findings in Markdown, HTML, PDF, or DOCX.

Community
Basic
MapleShawMapleShaw
170

content-signal-radar

Fetch and score AI builder content from X, podcasts, and blogs.

Community
Advanced
JingyiWngJingyiWng

databricks-unstructured-pdf-generation

Generate synthetic PDFs with question-answer JSON metadata into Unity Catalog volumes.

Community
Intermediate