audit-schema-gaps

Audit CultureMech LinkML schemas and YAML instances for validation gaps.

10|3|Updated Jan 28, 2026
One-click install
npx skills add https://github.com/CultureBotAI/CultureMech --skill audit-schema-gaps
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: audit-schema-gaps
Source: https://github.com/CultureBotAI/CultureMech/tree/main/.claude/skills/audit-schema-gaps
Command: npx skills add https://github.com/CultureBotAI/CultureMech --skill audit-schema-gaps

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires uv, linkml-validate, pyyaml, just, and includes scripts (resource) components.

What problem does it solve?

CultureMech can silently accept broken YAML records when validation is run in open mode or when exit codes are swallowed, causing schema drift and data quality issues to go unnoticed.

Core Features & Use Cases

  • Strict instance validation with closed-schema enforcement: Validates every normalized YAML instance and flags unexpected fields so failures cannot hide.
  • Schema-level probes and consistency checks: Audits identifier policies, naming divergence across term/ontology fields, requiredness inconsistencies, orphan enums, and broken range references.
  • Pipeline/writer assurance audit: Scans modules that write YAML to verify dry-run support, in-pipeline validation before writing, and whether safeguards are wired into existing just targets.
  • Actionable, ranked fix backlog: Produces machine-readable and narrative reports that prioritize fixes (starting with the CI gate) to prevent regressions.

Quick Start

Run the audit by asking an AI to execute: just validate-strict, then review the generated reports under reports/ for instance failures, schema gaps, and pipeline writer issues.

Frequently Asked Questions about audit-schema-gaps

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
Why does my LinkML validation pass YAML records but the data is still wrong?

LinkML validation passes incorrect YAML records when run in open mode or when exit codes are swallowed, allowing silent schema validation drift. Closed-schema enforcement with strict instance validation is required to detect unexpected fields and ensure records cannot hide failures.

How do I audit a LinkML schema for validation gaps and broken references?

Run a schema audit using programmatic probes to check identifier policies, naming divergence across ontology fields, requiredness inconsistencies, orphan enums, and broken range references. This detects structural schema gaps that allow invalid data to pass validation undetected.

How do I verify YAML pipeline writers support dry-run and validation before writing?

Scan pipeline modules that write YAML to verify dry-run support and in-pipeline validation before writing records. A pipeline assurance audit checks whether safeguards are wired into existing just targets to prevent unsafe writer behavior.

Do I need uv and pyyaml to run a schema consistency audit on normalized YAML instances?

Yes, running a strict schema audit requires uv, linkml-validate, pyyaml, and just. These dependencies enable closed-mode LinkML validation, YAML parsing, and execution of the audit targets needed to detect schema drift.

What is the best way to generate a prioritized fix backlog after a bulk YAML migration?

Execute an end-to-end schema and records audit to produce machine-readable TSV outputs and narrative reports. This generates a prioritized fix backlog starting with the CI gate, categorizing instance failures, schema gaps, and pipeline writer issues.

What are the limitations of running LinkML validation without closed-schema enforcement?

Without closed-schema enforcement, LinkML validation operates in open mode and silently accepts broken YAML records with unexpected fields. This limitation allows schema drift and data quality issues to go unnoticed because validation exit codes are effectively swallowed.