skills.rest
daffy0208
daffy0208COMMUNITY
Explore all skills by this author →
GitHub

Skill Validator

Validate skill implementations against manifests using Codex semantic comparisons.

34|7|Updated Oct 22, 2025
Search Tags:#testing#validation#codex#quality#governance#manifest#semantic
One-click install
npx skills add https://github.com/daffy0208/ai-dev-standards --skill skill-validator-daffy0208
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: Skill Validator
Source: https://github.com/daffy0208/ai-dev-standards/tree/main/SKILLS/skill-validator
Command: npx skills add https://github.com/daffy0208/ai-dev-standards --skill skill-validator-daffy0208

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires codex, python3, and includes scripts (resource) components.

What problem does it solve?

This Skill solves the critical problem of implementation-manifest drift, where code implementations diverge from their documented capabilities and requirements.

Core Features & Use Cases

  • Semantic Validation: Uses Codex AI to perform deep semantic analysis comparing descriptions, preconditions, and effects against actual code.
  • Use Case: Imagine you've updated a skill implementation. Use this Skill to automatically validate that all described functionality is actually implemented and no undocumented features have been added.

Quick Start

Use the Skill Validator to check if the implementation in the 'rag-implementer' directory matches its manifest description.

Frequently Asked Questions about Skill Validator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect when my skill implementation doesn't match its manifest description?▼

Skill Validator uses Codex-powered semantic analysis to compare your code implementation against manifest descriptions, preconditions, and effects. It flags description-implementation drift, missing capabilities, and over-promised features, producing metrics on accuracy and coverage.

Can I validate skills and MCP directories for undocumented features and capability gaps?▼

Yes. Skill Validator scans skill and MCP directories to detect both undocumented code additions and unimplemented promised features. It generates a descriptive validation artifact with drift metrics and inconsistency flags for remediation.

What's the best way to catch implementation-manifest drift during development and QA?▼

Run Skill Validator against your skill directory during development cycles and before releases. Semantic comparison across descriptions, preconditions, and API surfaces catches drift early, ensuring functional requirements are met before deployment.

Do I need Python and Codex to use Skill Validator?▼

Yes. Skill Validator requires Python 3 and Codex as dependencies. These enable the semantic analysis engine that compares implementations against manifest specifications.

What validation metrics does Skill Validator produce?▼

Skill Validator outputs accuracy, coverage, and drift metrics in a descriptive validation artifact. These metrics quantify how closely your implementation matches its manifest and identify specific inconsistencies requiring remediation.

When should I run validation—during development, QA, or release?▼

Apply Skill Validator throughout development, during QA cycles, and before releases. Early detection of drift prevents over-promised capabilities from reaching production and ensures manifest accuracy at every stage.

Related Skills

Explore More Software Engineering Skills→
ConsiliencyConsiliency
8

spec-discovery

Parse specs to extract IDs, titles, and SHA-256 hashes into a JSON or TOON manifest.

Official
Basic
channingwaltonchanningwalton
3

Memory

Persist and retrieve atomic memories with tags across sessions.

Community
Basic
arcasilesgrouparcasilesgroup
54

gap

Detect specification-vs-code, wiring, and correctness gaps in software projects.

Official
Advanced
Mte90Mte90
51

PHP Tooling

Manage PHP dependency, code quality, and debugging workflows.

Community
Intermediate