find-improvable-errors

Community

Find and fix unhelpful MCP error messages.

AuthorGregorStocks
Version1.0.0
Installs0

System Documentation

What problem does it solve?

The Find Improvable Error Messages Skill identifies MCP tool error messages across game exports that hinder model recovery and proposes targeted improvements to reduce stuck retries.

Core Features & Use Cases

  • Surface the least helpful error messages by analyzing game exports and computing metrics such as stuck rate, recovery rate, and message volume.
  • Diagnose why poor messages fail by examining error text, action_type distributions, model performance, and representative failure examples from exports.
  • Propose concrete fixes by documenting and editing the error-handling strings in the codebase (e.g., BridgeCallbackHandler.java), regenerating MCP tooling, and validating improvements with follow-up analysis.
  • Provide an end-to-end workflow from data analysis to patch validation in magebench.

Quick Start

Run the analysis against all exported games to surface the least helpful error messages and begin diagnosing improvements.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: find-improvable-errors
Download link: https://github.com/GregorStocks/mage-bench/archive/main.zip#find-improvable-errors

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.