blunder-backfill

Backfill outdated blunder analyses for recent MageBench games using Sonnet 4.5.

64|8|Updated Oct 24, 2025
One-click install
npx skills add https://github.com/GregorStocks/mage-bench --skill blunder-backfill
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: blunder-backfill
Source: https://github.com/GregorStocks/mage-bench/tree/main/.claude/skills/blunder-backfill
Command: npx skills add https://github.com/GregorStocks/mage-bench --skill blunder-backfill

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Backfill outdated or missing blunder analyses for recent MageBench games to ensure complete playback insights and consistent evaluation records.

Core Features & Use Cases

  • Run the backfill script on the most recent N outdated games (default 10).
  • Identify games with blunderScriptVersion older than current or missing annotations.
  • Execute per-decision Sonnet 4.5 analysis on each identified game.
  • Produce a cost breakdown per game and highlight improvements.
  • Requires OPENROUTER_API_KEY in the environment.

Quick Start

Run the backfill script on the most recent outdated games using uv run python -m magebench.analysis.toolbox.backfill_annotations [N]

Frequently Asked Questions about blunder-backfill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I backfill missing blunder analysis for recent game logs?▼

You can backfill blunder analysis by running the backfill script on the most recent N outdated games. It identifies entries with outdated or missing annotations and applies per-decision Sonnet 4.5 analysis to generate complete playback insights.

What is blunder backfill annotation for game logs?▼

Blunder backfill annotation updates outdated or missing blunder analyses for recent MageBench games to ensure complete playback insights and consistent evaluation records. It processes recent non-annotated or outdated game log entries to apply current analysis.

Do I need an OpenRouter API key to run game annotation backfill?▼

Yes, an OPENROUTER_API_KEY is required in your environment to run the blunder backfill. The script uses this key to execute the per-decision Sonnet 4.5 analysis that generates the required game annotations and cost breakdowns.

How many outdated games can the backfill script process at once?▼

The backfill script processes the most recent N outdated games, defaulting to 10. You can specify a different number by passing your desired value as an argument when running the backfill command from the toolbox.

Can I use the backfill script for multiplayer Commander session logs?▼

Yes, the backfill script supports multiplayer Commander session logs. It applies to recent game logs from both 1v1 duels and multiplayer Commander sessions, processing the most recent non-annotated or outdated entries to ensure complete records.