skill-consistency-review

To check for deterministic output, freeze the inputs, run the packaged skill multiple times, and diff the resulting artifacts to detect any run-to-run drift. This process verifies output repeatability and consistency.

Artifact portability means outputs do not depend on a specific environment or path layout. A portability check detects artifacts relying on specific paths, ensuring they function as standalone deliverables across different environments.

Verifying packaging integrity involves checking that the skill root contains the required SKILL.md frontmatter and confirming all bundled resources, scripts, and reference files are present and correctly structured.

Yes, you can test output consistency for unzipped skill directories that generate reports, templates, or HTML. The review applies to both packaged and unzipped directories by running them repeatedly with frozen inputs and comparing artifacts.

Your skill likely produces different outputs due to environment dependencies or non-deterministic scripts. Diffing artifacts from multiple runs with frozen inputs identifies the exact files causing drift and highlights portability issues.

The best way to review repeatability and packaging issues is to freeze inputs, execute the skill multiple times, diff the resulting artifacts, and verify the presence of SKILL.md, scripts, and reference files to produce a developer-facing findings document.