skill-tester

Validate Claude skills for structure, Python syntax, and quality scoring.

Updated Mar 18, 2026

Search Tags:#automation #testing #ci/cd #python #static-analysis #quality-assurance #skill-validation

Ready to run

npx skills add https://github.com/DipakMandlik/Pi-Skills --skill skill-tester-dipakmandlik

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: skill-tester
Source: https://github.com/DipakMandlik/Pi-Skills/tree/main/engineering/skill-tester
Command: npx skills add https://github.com/DipakMandlik/Pi-Skills --skill skill-tester-dipakmandlik

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

Automates the validation, testing, and scoring of Claude skills to ensure consistent quality and reliable CI/CD outcomes.

Core Features & Use Cases

Structure Validation: ensures skills conform to required directory structures, file formats, and documentation standards.
Script Testing: validates Python scripts for syntax, imports, functionality, and output format compliance.
Quality Scoring: provides multi-dimensional assessment with actionable improvement recommendations.
Use Case: CI pipelines gate skills before merging.

Quick Start

Run the Skill Tester against a skill directory to validate structure, test scripts, and generate a quality score.

Frequently Asked Questions about skill-tester

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate Claude skill validation in a CI pipeline?▼

Automate Claude skill validation by running the skill-tester against a skill directory to enforce SKILL.md compliance, check directory structures, and parse YAML frontmatter before merging. This quality gate ensures consistent CI/CD outcomes by validating structure and scripts.

How do I validate Python scripts for syntax and imports without external dependencies?▼

Validate Python scripts using skill-tester to perform syntax checks and import validation restricted to the standard library only. This ensures scripts are functionally correct, output format compliant, and free of unauthorized external dependencies.

What is multi-dimensional quality scoring for skill assessment?▼

Multi-dimensional quality scoring assesses Claude skills across various criteria to generate actionable improvement recommendations and tier guidance. It evaluates structure compliance, script correctness, and overall quality during manual audits or automated checks.

Can I use skill-tester for pre-commit checks and manual audits?▼

Yes, skill-tester supports both pre-commit hooks and manual audits by running validation checks against skill directories. It assesses SKILL.md compliance, verifies script correctness, and generates quality scores to enforce standards locally or in CI pipelines.

Does skill-tester require any external dependencies to function?▼

No, skill-tester has zero external dependencies. It performs Python syntax and import validation using only the standard library, ensuring the testing and scoring environment remains self-contained and portable across different CI/CD setups.

Why does my skill fail the quality gate during CI validation?▼

Skills fail the quality gate when they lack required directory structures, proper YAML frontmatter, or valid SKILL.md documentation. Python scripts with syntax errors, invalid imports, or non-compliant output formats also trigger failures during automated testing.