skill-creator-smoke-test

Runs positive and negative smoke-test gates against candidate meta-skill SKILL.md files.

6.8k|540|Updated May 6, 2026
One-click install
npx skills add https://github.com/opensquilla/opensquilla --skill skill-creator-smoke-test
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator-smoke-test
Source: https://github.com/opensquilla/opensquilla/tree/main/src/opensquilla/skills/bundled/skill-creator-smoke-test
Command: npx skills add https://github.com/opensquilla/opensquilla --skill skill-creator-smoke-test

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

When generating new meta-skills automatically, you need a way to verify that a candidate SKILL.md actually triggers on relevant inputs and rejects irrelevant ones before shipping it. This internal sub-agent runs the G3 (positive smoke) and G4 (negative smoke) validation gates as a DAG step inside the meta-skill-creator workflow.

Core Features & Use Cases

  • Positive Smoke Gate (G3): Generates a positive fixture with an LLM and calls simulate_meta_resolution to confirm the candidate skill resolves correctly.
  • Negative Smoke Gate (G4): Generates a cross-domain negative fixture to confirm the skill does not falsely trigger.
  • Cross-Vendor Validation: Uses a different LLM for fixture generation than for classification to avoid self-confirmation bias.
  • Degraded Fallback: Falls back to a deterministic fixture generator with a stub classifier when OPENROUTER_API_KEY or model configuration is missing, marking results with a degraded flag.
  • Use Case: As part of an automated skill-authoring pipeline, invoke this step after drafting a candidate SKILL.md to receive a JSON report of G3/G4 gate results before accepting the new skill.

Quick Start

Invoke this as a kind: agent step within the meta-skill-creator DAG, passing skill_md, fixture_gen_model, and classifier_model in the step's with block.

Frequently Asked Questions about skill-creator-smoke-test

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate a generated SKILL.md before publishing it?

Run smoke-test gates that simulate skill resolution with positive and negative fixtures. A positive fixture confirms the skill triggers on relevant input, while a cross-domain negative fixture confirms it does not falsely trigger on unrelated input.

What are G3 and G4 gates in skill creation?

G3 is the positive smoke gate verifying a candidate SKILL.md resolves correctly on a relevant fixture, and G4 is the negative smoke gate verifying it rejects cross-domain input. Both return structured JSON pass/fail records.

Can users invoke the skill-creator-smoke-test directly?

No, it is an internal tool marked user-invocable: false with model invocation disabled. It is only called by the meta-skill-creator as a kind: agent DAG step with skill_md, fixture_gen_model, and classifier_model parameters.

What happens if OPENROUTER_API_KEY is missing during smoke testing?

The sub-agent falls back to a deterministic fixture generator and pins the classifier model to stub. It still emits G3 and G4 records but marks them with a degraded: true flag to signal reduced validation confidence.

Why use different LLMs for fixture generation and classification?

Cross-vendor validation prevents self-confirmation bias where the same model both generates and judges test fixtures. Using distinct models for fixture generation and classification produces more trustworthy smoke-test results.