skill-comply

Generate compliance reports by classifying agent tool calls against behavioral specs.

Updated Apr 2, 2026
One-click install
npx skills add https://github.com/richardnpaul/everything-vscode-copilot --skill skill-comply-richardnpaul
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-comply
Source: https://github.com/richardnpaul/everything-vscode-copilot/tree/main/.github/skills/skill-comply
Command: npx skills add https://github.com/richardnpaul/everything-vscode-copilot --skill skill-comply-richardnpaul

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) components.

What problem does it solve?

Visualize and quantify whether skills, rules, and agent definitions are actually followed during agent runs.

Core Features & Use Cases

  • Auto-generates expected behavioral sequences from skill definitions
  • Creates three scenarios with decreasing prompt strictness (supportive → neutral → competing)
  • Runs agent sessions and captures full tool call timelines
  • Classifies tool calls against the generated spec
  • Produces self-contained reports with timelines and compliance rates

Quick Start

Run skill-comply on a skill path to generate a spec, scenarios, and a compliance report.

Frequently Asked Questions about skill-comply

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I measure whether my coding agent follows defined skills and rules?

You can measure agent compliance by generating expected behavioral sequences from skill definitions, running the agent through varying prompt scenarios, and comparing the recorded tool-call timeline against the spec to calculate a compliance rate.

What is agent compliance reporting and how does it work?

Agent compliance reporting quantifies whether coding agents follow defined skills by generating expected behavioral sequences, running three scenarios with decreasing prompt strictness, classifying tool usage against the spec, and reporting a compliance score.

How do I test coding agent behavior under varying prompt strictness?

You can test agent behavior by running three scenario prompts with decreasing strictness—from supportive to neutral to competing—and capturing the full tool call timeline to classify whether the agent still follows the defined skills.

Does this compliance reporting tool require any specific dependencies to run?

Yes, the compliance reporting tool requires the pyyaml dependency to parse skill definitions and generate the expected behavioral sequences needed for measuring agent compliance.

Can I check temporal ordering of tool calls against a generated spec?

Yes, the tool records a full tool-call timeline during the agent run, classifies tool usage against the generated spec, and checks temporal ordering to verify that the agent executed actions in the expected sequence.

What's the best way to automate skill compliance checks for coding agents?

The best way to automate compliance checks is to run a script that auto-generates behavioral specs from skill definitions, executes scenario sessions, and produces self-contained reports with timelines, compliance rates, and hook-promotion guidance.