skill-comply

Convert Markdown skill and rule expectations into executable compliance specs with graded tool-call traces.

Updated Sep 13, 2025
One-click install
npx skills add https://github.com/llmh333/employee_management_spring --skill skill-comply-llmh333
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-comply
Source: https://github.com/llmh333/employee_management_spring/tree/main/.gemini/skills/skill-comply
Command: npx skills add https://github.com/llmh333/employee_management_spring --skill skill-comply-llmh333

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) components.

What problem does it solve?

This Skill helps you verify whether coding agents actually follow specified workflows, rules, or agent definitions—rather than merely producing plausible outputs.

Core Features & Use Cases

  • Generates expected behavior specs from your skill/rule Markdown, turning prose instructions into measurable step definitions.
  • Creates 3 scenario variants with decreasing prompt strictness (supportive → neutral → competing) to test prompt independence.
  • Runs agent scenarios and captures tool-call timelines to produce deterministic, evidence-backed compliance scores.
  • Classifies tool calls against step meanings using an LLM and checks required vs optional steps with ordering constraints.

Quick Start

Run the skill compliance check for a rule or skill file at .gemini/rules/common/testing.md to generate an evidence-backed report with compliance rates.

Frequently Asked Questions about skill-comply

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify that coding agents follow my markdown workflow rules?

To verify that coding agents follow markdown workflow rules, you can convert specified prose instructions into executable compliance specs and grade actual tool-call traces against those step meanings. This produces evidence-backed compliance rates and per-step detection results in a Markdown report.

What is the best way to test prompt strictness for LLM agent compliance?

Testing prompt strictness for LLM agent compliance involves generating three comparable scenario variants with decreasing prompt strictness: supportive, neutral, and competing. This evaluates prompt independence by capturing tool-call timelines to score agent workflow verification deterministically.

Can I use pyyaml to parse markdown expectations for scenario generation?

Yes, you can use pyyaml to parse markdown expectations for scenario generation. The skill depends on pyyaml to convert markdown-based expectations into measurable step definitions for agent compliance checking and workflow verification.

Does this tool check temporal ordering of required steps in agent traces?

Yes, this tool checks temporal ordering of required steps in agent traces. It uses LLM-based tool-call classification combined with deterministic temporal ordering checks to verify required versus optional steps against expected behavior specs.

How do I measure tool call tracing against expected behavior specs?

You measure tool call tracing against expected behavior specs by running agent scenarios and capturing full tool-call timelines. An LLM then classifies these tool calls against step meanings to produce deterministic compliance scores and optional hook-promotion recommendations.

When do I need workflow verification for skills under skills/*/SKILL.md?

You need workflow verification for skills under skills/*/SKILL.md when you want to ensure coding agents actually follow specified workflows rather than merely producing plausible outputs. It applies to rules under rules/common/*.md using gemini scenario runs.