skill-test-harness

Automate regression testing for script validation by executing scripts against predefined test cases with fixtures. This framework compares current outputs against baselines to detect unintended changes, ensuring scanner integrity after updates.

Assertion types for validating scanner outputs include exit code validation, file existence checks, output content verification, and JSON field comparisons. These assertions ensure scripts meet expected functional criteria during execution.

Run automated tests by configuring the harness with your tests.json file and scripts directory. The framework executes the defined test cases, applying fixtures and assertions to validate script behavior automatically.

Fixture management in automated testing helps prevent false positives by providing consistent, controlled input data for test cases. Validating scanner outputs against these fixtures ensures scripts accurately identify vulnerabilities without triggering false alarms.

Script regression detection can be integrated into CI/CD workflows to automatically verify script integrity after modifications. The testing framework executes predefined suites to identify regressions before they impact the production system.