agents-md-evals

Evaluate AGENTS.md instruction files via controlled A/B testing.

10|1|Updated Mar 10, 2026
One-click install
npx skills add https://github.com/vltansky/skills --skill agents-md-evals
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: agents-md-evals
Source: https://github.com/vltansky/skills/tree/main/skills/agents-md-evals
Command: npx skills add https://github.com/vltansky/skills --skill agents-md-evals

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill helps you identify and remove redundant or ineffective instructions from your AI configuration files (like AGENTS.md or CLAUDE.md), saving valuable context tokens and improving AI performance.

Core Features & Use Cases

  • A/B Testing: Rigorously tests instruction rules by comparing performance with and without them.
  • Rule Categorization: Identifies rules related to coding style, workflow, decision style, and more.
  • Performance Benchmarking: Grades and benchmarks results to pinpoint rules that don't earn their tokens.
  • Use Case: You suspect your extensive AGENTS.md file is wasting tokens. This Skill will run controlled tests to show you exactly which rules are essential and which can be safely removed.

Quick Start

Use the agents-md-evals skill to evaluate your AGENTS.md file.

Frequently Asked Questions about agents-md-evals

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize AI instructions in CLAUDE.md or AGENTS.md files?

Benchmark AI instruction performance by grading rules against codebase patterns to pinpoint which instructions do not earn their tokens, allowing you to remove ineffective rules and improve AI performance.

What is the best way to test if my AGENTS.md rules are actually working?

Clean file isolation protocols are required for baseline runs to ensure accurate A/B testing. You also need git log analysis for prompt generation to properly evaluate and benchmark instruction performance.

Can I identify which coding style rules in my AGENTS.md file are wasting context tokens?

Yes, the Skill evaluates extensive configuration files by rigorously testing instruction rules, categorizing them by coding style or workflow, and benchmarking performance to show exactly which rules are essential.

What prerequisites do I need to evaluate my AI configuration files?

Evaluating AI configuration files requires git log analysis for prompt generation and clean file isolation protocols for baseline runs to ensure accurate A/B testing and performance benchmarking.