gauntlet-test-authoring

What problem does it solve?

This Skill ensures that code is verified against its specifications without the verifier seeing the implementation, enforcing a strict blind testing discipline to prevent collusion and ensure thorough code testing.

Core Features & Use Cases

• Blind Verification: Ensures that verifiers write tests based solely on specifications, not the implementation.
• Multi-Model Skill Loading: Loads different sets of skills based on the model's role (Net, Filter, Tiebreaker) to optimize test coverage.
• Property-Based Testing: Uses property-based testing to catch overfitting and ensure code correctness.
• Sanity Baseline: Ensures that tests fail against a no-op stub to catch ineffective tests.
• Mutation Testing: Integrates mutation testing to validate the strength of the test suite.
• Output Format: Defines a structured output format for test results and metadata.
• Use Case: In a software development project, use this Skill to verify that the code written by a developer adheres to the specified requirements without the verifier seeing the actual code.

Quick Start

Use the gauntlet-test-authoring skill to write tests for a given spec, ensuring they pass all tests without seeing the implementation.