skills.rest
tmuskal
tmuskalCOMMUNITY
Explore all skills by this author →
𝕏@tmuskalGitHub

longmemeval-resume

Resume incomplete LongMemEval benchmark runs from the last checkpoint.

3|1|Updated Apr 11, 2026
Search Tags:#benchmarking#resumption#longmemeval#checkpoint continuation#incomplete run
One-click install
npx skills add https://github.com/tmuskal/arc-agi-benchmarker --skill longmemeval-resume
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: longmemeval-resume
Source: https://github.com/tmuskal/arc-agi-benchmarker/tree/main/plugins/longmemeval-benchmarker/skills/resume
Command: npx skills add https://github.com/tmuskal/arc-agi-benchmarker --skill longmemeval-resume

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill allows users to pick up where they left off in an incomplete LongMemEval run, saving time and ensuring continuity in the benchmarking process.

Core Features & Use Cases

  • Incomplete Run Detection: Identifies the most recent incomplete run.
  • Checkpoint Continuation: Picks up the task from the last known checkpoint.
  • Status Update: Updates the run status to 'completed' once finished.
  • Use Case: Suppose you've started a LongMemEval benchmark but had to stop due to system issues. With this Skill, you can resume the run without losing progress.

Quick Start

To continue the last incomplete run, use the command: /longmemeval-resume:continue

Frequently Asked Questions about longmemeval-resume

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I resume an incomplete LongMemEval benchmark run?▼

To resume an incomplete LongMemEval benchmark run, execute the `/longmemeval-resume:continue` command. This identifies the most recent checkpoint and seamlessly continues the benchmarking task from where it stopped.

What is checkpoint continuation for incomplete benchmarking tasks?▼

Checkpoint continuation for benchmarking tasks means detecting the last saved state of an incomplete run and picking up execution from that exact point. This prevents losing progress and avoids restarting the evaluation from scratch.

How do I start LongMemEval checkpoint continuation from the command line?▼

Start LongMemEval checkpoint continuation by running `/longmemeval-resume:continue`. The script identifies the last checkpoint of your incomplete run and seamlessly resumes the benchmarking process without losing prior progress.

Does LongMemEval resumption require Python scripting?▼

Yes, LongMemEval resumption requires Python scripting for checkpoint identification and status update logic. You need a Python environment configured to execute the continuation scripts and manage the benchmark run state.

Related Skills

Explore More Software Engineering Skills→
tmuskaltmuskal
3

compare-runs

Compare two LongMemEval runs by scorecards, harness configurations, and per-question-type accuracy.

Community
Intermediate
tmuskaltmuskal
3

LongMemEval Judge

Evaluate QA answers in the LongMemEval benchmark using Anthropic or OpenAI services.

Community
Intermediate
tmuskaltmuskal
3

report

Generate LongMemEval benchmark reports in markdown, JSON, or summary formats.

Community
Intermediate
ArogyaReddyArogyaReddy

llm-evaluation

Automates LLM output evaluation with metrics, human feedback, and benchmarking.

Community
Advanced