skill-comply

Grade coding agent tool-call traces against expected sequences for skill compliance.

1|Updated Mar 3, 2026
One-click install
npx skills add https://github.com/samymity/bridge-ventures-backend --skill skill-comply-samymity
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-comply
Source: https://github.com/samymity/bridge-ventures-backend/tree/main/.claude/skills/skill-comply
Command: npx skills add https://github.com/samymity/bridge-ventures-backend --skill skill-comply-samymity

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) components.

What problem does it solve?

It reveals whether Claude Code agents actually comply with your declared skills or rules, even when the prompt only loosely supports them, preventing silent process drift.

Core Features & Use Cases

  • Compliance measurement: Auto-generates an expected behavioral sequence and grades agent tool-call traces against it.
  • Prompt-strictness stress testing: Runs the same task at 3 strictness levels (supportive, neutral, competing) to detect when compliance breaks.
  • Deterministic scoring + LLM classification: Uses an LLM to map tool calls to spec steps, then enforces temporal ordering deterministically.
  • Actionable reporting: Produces self-contained Markdown reports with compliance rates and full tool-call timelines.

Quick Start

Run the compliance check for a skill or rule file using: uv run python -m scripts.run path/to/SKILL.md.

Frequently Asked Questions about skill-comply

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify if an agent follows specific workflow validation rules?

To verify agent compliance, you generate an expected tool-call sequence and grade observed agent traces against it. This workflow validation checks whether coding agents follow declared rules by testing task scenarios across different prompt strictness levels.

What is LLM classification for tool-call tracing in agent compliance?

LLM classification for tool-call tracing maps observed agent tool calls to expected spec steps. It uses an LLM to classify calls, then enforces deterministic temporal ordering validation to ensure the agent followed the correct sequence.

How do I test agent compliance when prompt strictness varies?

You test agent compliance across varying prompt strictness by running the same task at three levels: supportive, neutral, and competing. This stress testing detects when compliance breaks down under loosely supporting or competing prompt conditions.

How do I generate a compliance report for agent tool-call traces?

You generate a self-contained Markdown compliance report containing compliance rates and full tool-call timelines. This output summarizes whether agents followed declared behaviors and includes the complete trace history for review.

Do I need pyyaml to run agent compliance checks?

Yes, you need pyyaml installed as a dependency to run agent compliance checks. The skill requires this Python library to parse configuration files and execute the compliance verification scripts.

What's the best way to detect silent process drift in coding agents?

The best way to detect silent process drift is to measure agent compliance by generating expected behavioral sequences and grading observed tool-call traces against them. This reveals whether agents comply with declared skills even when prompts loosely support them.