skill-comply

Generate specs, scenarios, tool-call traces, and compliance reports for coding agents.

Updated Apr 4, 2026
One-click install
npx skills add https://github.com/mitul-bhatia/Vibes --skill skill-comply-mitul-bhatia
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-comply
Source: https://github.com/mitul-bhatia/Vibes/tree/main/.github/skills/skill-comply
Command: npx skills add https://github.com/mitul-bhatia/Vibes --skill skill-comply-mitul-bhatia

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) components.

What problem does it solve?

Visualize whether coding agents adhere to defined skills, rules, and agent definitions by automatically generating scenarios, executing agent runs, classifying tool calls, and producing compliance timelines.

Core Features & Use Cases

  • Auto-generates observable specs from skill files
  • Generates three prompt-strictness scenarios (supportive, neutral, competing)
  • Runs Claude to collect tool-call traces and classifies them against specs
  • Produces self-contained reports with timelines and compliance scores

Quick Start

Run the compliance pipeline to generate a spec, scenarios, and a final report for the skill.

Frequently Asked Questions about skill-comply

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I measure whether coding agents follow defined rules and skills?

You can measure coding agent rule compliance by automatically generating observable specs from skill files, running agent scenarios, and classifying tool-call traces against those specs to produce structured timeline reports.

What is the best way to verify LLM agent behavior against agent definitions?

The best way to verify LLM agent behavior is by running deterministic sequencing alongside LLM-based classification to evaluate tool-call traces against defined agent definitions and generate self-contained compliance reports.

How do I generate compliance scenarios to test coding agents?

You generate compliance scenarios by creating three prompt-strictness variations—supportive, neutral, and competing—which test how coding agents adhere to rules under different instruction strengths.

Can I use YAML to configure agent compliance testing scenarios?

Yes, you can configure agent compliance testing using YAML files, as the pipeline relies on the pyyaml dependency to parse skill definitions and generate observable specs and scenarios.

What do agent compliance timeline reports include?

Agent compliance timeline reports include self-contained visual timelines and compliance scores that map classified tool-call traces against the specs generated from your skill and rule definitions.