blunder-backfill

Backfill outdated blunder analyses for recent MageBench games using Sonnet 4.5.

64|8|Updated Oct 24, 2025
One-click install
npx skills add https://github.com/GregorStocks/mage-bench --skill blunder-backfill
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: blunder-backfill
Source: https://github.com/GregorStocks/mage-bench/tree/main/.claude/skills/blunder-backfill
Command: npx skills add https://github.com/GregorStocks/mage-bench --skill blunder-backfill

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Backfill outdated or missing blunder analyses for recent MageBench games to ensure complete playback insights and consistent evaluation records.

Core Features & Use Cases

  • Run the backfill script on the most recent N outdated games (default 10).
  • Identify games with blunderScriptVersion older than current or missing annotations.
  • Execute per-decision Sonnet 4.5 analysis on each identified game.
  • Produce a cost breakdown per game and highlight improvements.
  • Requires OPENROUTER_API_KEY in the environment.

Quick Start

Run the backfill script on the most recent outdated games using uv run python -m magebench.analysis.toolbox.backfill_annotations [N]

Frequently Asked Questions about blunder-backfill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I backfill missing blunder analysis for recent game logs?

You can backfill blunder analysis by running the backfill script on the most recent N outdated games. It identifies entries with outdated or missing annotations and applies per-decision Sonnet 4.5 analysis to generate complete playback insights.

What is blunder backfill annotation for game logs?

Blunder backfill annotation updates outdated or missing blunder analyses for recent MageBench games to ensure complete playback insights and consistent evaluation records. It processes recent non-annotated or outdated game log entries to apply current analysis.

Do I need an OpenRouter API key to run game annotation backfill?

Yes, an OPENROUTER_API_KEY is required in your environment to run the blunder backfill. The script uses this key to execute the per-decision Sonnet 4.5 analysis that generates the required game annotations and cost breakdowns.

How many outdated games can the backfill script process at once?

The backfill script processes the most recent N outdated games, defaulting to 10. You can specify a different number by passing your desired value as an argument when running the backfill command from the toolbox.

Can I use the backfill script for multiplayer Commander session logs?

Yes, the backfill script supports multiplayer Commander session logs. It applies to recent game logs from both 1v1 duels and multiplayer Commander sessions, processing the most recent non-annotated or outdated entries to ensure complete records.