What problem does it solve?
Provides objective, repeatable measurement of whether coding agents follow documented skills, rules, and agent definitions by turning prose into observable specs and verifying actual tool-call timelines.
Core Features & Use Cases
- Spec Generation: Auto-extracts an expected behavioral sequence from a skill/rule Markdown file.
- Scenario Pressure Testing: Creates three scenarios (supportive, neutral, competing) to probe prompt independence.
- Trace Collection & Analysis: Executes scenarios via claude -p, captures stream-json tool-call traces, classifies events with an LLM, enforces temporal ordering, and emits a self-contained Markdown compliance report.
- Use Case: Validate TDD workflows, security or linting rules, and whether specialized agents invoke expected behaviors under adversarial prompts.
Quick Start
Run skill-comply on a SKILL.md path to generate a compliance spec, execute three scenarios against an agent, and produce a Markdown report summarizing compliance rates and timelines.