Challenge unit tests to detect false positives from implementation-derived oracles.
npx skills add https://github.com/AndurilCode/craftwork --skill test-challenger
Please help me install this Agent Skill. Skill: test-challenger Source: https://github.com/AndurilCode/craftwork/tree/main/skills/test-challenger Command: npx skills add https://github.com/AndurilCode/craftwork --skill test-challenger
It challenges unit tests that appear to “pass” while secretly validating the implementation instead of the intended specification, helping you avoid false confidence from brittle or tautological tests.
Ask the skill to challenge your tests by providing the test file(s) and the source file(s) they are intended to validate, and request a pattern-based verdict plus remediation steps.
High-intent search queries and answers about installing and using this skill.
Detect false-positive unit tests by challenging the test suite against the source code to identify oracles derived from the implementation. This auditing process classifies tests as Solid, Suspicious, Likely False Positive, or Vacuous using a catalog of challenge patterns.
Tests pass despite wrong behavior because coverage-driven tests often derive their oracle from running the implementation rather than the specification. Auditing these tests reveals tautological patterns that validate the code instead of verifying correct behavior.
Audit coverage-driven tests by providing the test files and corresponding source files to challenge against a false-positive pattern catalog. This produces a per-test verdict and recommends concrete remediation like independent-oracle rewrites and boundary test coverage.
Fix vacuous or tautological unit tests by applying remediation guidance such as rewriting with independent oracles, adding boundary or negative test coverage, introducing property-based testing, or deleting vacuous tests entirely.
Review a test suite to check spec vs implementation validation by challenging the tests to detect false-positive patterns. This highlights highest-risk findings where the oracle comes from running the code rather than independent domain truth.
cwilliams5Audit AutoHotkey test suites for dead, duplicative, and stale tests.
Ramprasad4121Verify suspected security bugs and produce documented TRUE POSITIVE or FALSE POSITIVE verdicts.
nashgaoAudit, classify, and rewrite confirmation-style tests into specification-first TDD tests.
mikemylExecute Stryker mutation testing on JavaScript and TypeScript codebases.
