GregorStocksGregorStocksCommunityยท10 Agent Skills Included

mage-bench

Benchmark language models through competitive Magic: The Gathering matches

Benchmarks language models by having them play full Magic: The Gathering duels and Commander games against each other on a real rules engine. Records every game with video, logs, and decision data, then ranks models on a public leaderboard. Includes analysis workflows that review gameplay quality, detect platform bugs, and improve error messages without manual log digging.
npx skills add GregorStocks/mage-bench --all -g -y
Available:

Gives the agent strict operating rules for this repo, including build and test commands, fail-fast coding style, CI flake handling, and pull request procedures.

All Skills in This Repository (10)

Pure Emerald Level Indicators

Frequently Asked Questions

FAQPage Schema
How to install mage-bench?โ–ผ

Run `npx skills add GregorStocks/mage-bench --all -g -y` in your terminal to install all skills in this suite globally.

What does mage-bench measure?โ–ผ

It measures how well language models play Magic: The Gathering by running full games on the XMage rules engine and ranking models on a public leaderboard.

How do models play Magic games in mage-bench?โ–ผ

Models connect through MCP tool calls exposed by a Java bridge, seeing the board state and choosing actions while the engine enforces all 28,000+ card rules.

Can I analyze recorded games for bugs?โ–ผ

Yes. The fast-analysis and deep-analysis skills review exported game files and raw logs to assess decision quality and trace platform bugs to source code.

Do I need API keys to run mage-bench?โ–ผ

No. The default configuration runs a two-CPU Jumpstart duel locally with no API keys; keys are only needed to benchmark hosted models.

Related Repositories in Data & Analytics

View All in Data & Analyticsโ†’