diagnose

Validate autoimprove.yaml configuration and dry-run gates and benchmarks.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/tokyo-megacorp/autoimprove --skill diagnose-tokyo-megacorp
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: diagnose
Source: https://github.com/tokyo-megacorp/autoimprove/tree/main/skills/diagnose
Command: npx skills add https://github.com/tokyo-megacorp/autoimprove --skill diagnose-tokyo-megacorp

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps users verify the correctness of their autoimprove.yaml configuration, diagnose failures in gates and benchmark metrics, and troubleshoot extraction issues, preventing costly mistakes during automated optimization processes.

Core Features & Use Cases

  • Config Validation: Checks the structural integrity and required fields of autoimprove.yaml.
  • Gate & Benchmark Dry Runs: Executes commands to ensure gates complete successfully and benchmarks produce expected outputs.
  • Metric Extraction Debugging: Tests regex or jq extraction patterns against live benchmark outputs to identify issues with data parsing.
  • Use Case: A developer running autoimprove encounters unexplained missing metrics; diagnose runs a thorough check of config, gate commands, and metric patterns to identify mismatches or errors.

Quick Start

Use the diagnose skill to validate your autoimprove.yaml configuration and test your gate commands and metric extraction patterns before starting autoimprove experiments.

Frequently Asked Questions about diagnose

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate my autoimprove.yaml configuration before running optimization experiments?

You can validate your autoimprove.yaml configuration by checking its structural integrity and required fields, ensuring reliable automated codebase improvements and preventing costly mistakes during optimization processes.

Why are my benchmark metrics missing or failing to extract during automated codebase improvements?

Missing benchmark metrics during automated codebase improvements usually stem from mismatches in regex or jq extraction patterns tested against live benchmark outputs, or from failing gate commands that prevent benchmarks from completing successfully.

What is the best way to debug failing gates and metric extraction patterns?

The best way to debug failing gates and metric extraction patterns is to execute dry-test runs for gates and benchmarks, then probe regex or jq extraction patterns against live outputs to identify data parsing issues.

Can I test gate commands and benchmark outputs without starting a full autoimprove experiment?

Yes, you can execute dry-test runs for gates and benchmarks to ensure commands complete successfully and produce expected outputs without starting a full automated optimization experiment.

How does probing metric extraction patterns against live benchmark outputs work?

Probing metric extraction patterns works by testing your regex or jq patterns against live benchmark outputs to identify data parsing issues and ensure automated codebase improvements capture the correct metrics reliably.