skill-test-harness

Run automated tests for skill scripts with fixtures and assertions.

Updated Mar 13, 2026

Search Tags:#automation #testing #script validation #CI/CD #regression testing

Ready to run

npx skills add https://github.com/TECHKNOWMAD-LABS/cortex-research-suite --skill skill-test-harness

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: skill-test-harness
Source: https://github.com/TECHKNOWMAD-LABS/cortex-research-suite/tree/main/skills/skill-test-harness
Command: npx skills add https://github.com/TECHKNOWMAD-LABS/cortex-research-suite --skill skill-test-harness

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the process of testing skill scripts, ensuring their reliability and detecting regressions before they impact the system.

Core Features & Use Cases

Automated Testing: Executes skill scripts against predefined test cases with fixtures and assertions.
Regression Detection: Compares current test results against baselines to identify unintended changes.
Use Case: After updating a security scanning script, use this Skill to run a suite of tests that verify it still correctly identifies vulnerabilities and doesn't produce false positives.

Quick Start

Run the skill-test-harness skill using the provided test file 'tests.json' and script directory './scripts'.

Frequently Asked Questions about skill-test-harness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate regression testing for script validation after modifications?▼

Automate regression testing for script validation by executing scripts against predefined test cases with fixtures. This framework compares current outputs against baselines to detect unintended changes, ensuring scanner integrity after updates.

What assertion types are available for validating scanner outputs in a test harness?▼

Assertion types for validating scanner outputs include exit code validation, file existence checks, output content verification, and JSON field comparisons. These assertions ensure scripts meet expected functional criteria during execution.

How do I run automated tests using a tests.json file and a scripts directory?▼

Run automated tests by configuring the harness with your tests.json file and scripts directory. The framework executes the defined test cases, applying fixtures and assertions to validate script behavior automatically.

Does fixture management in automated testing help prevent false positives in security scanning scripts?▼

Fixture management in automated testing helps prevent false positives by providing consistent, controlled input data for test cases. Validating scanner outputs against these fixtures ensures scripts accurately identify vulnerabilities without triggering false alarms.

Can I integrate script regression detection into my CI/CD workflow?▼

Script regression detection can be integrated into CI/CD workflows to automatically verify script integrity after modifications. The testing framework executes predefined suites to identify regressions before they impact the production system.