proof-covers-the-wrong-thing

Audits verification evidence to expose proofs that cover the wrong surface, reader, caller, or premise.

96|11|Updated Feb 8, 2026
One-click install
npx skills add https://github.com/thefrederiksen/devthrottle --skill proof-covers-the-wrong-thing-thefrederiksen
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: proof-covers-the-wrong-thing
Source: https://github.com/thefrederiksen/devthrottle/tree/main/plugins/agent-discipline/skills/proof-covers-the-wrong-thing
Command: npx skills add https://github.com/thefrederiksen/devthrottle --skill proof-covers-the-wrong-thing-thefrederiksen

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Engineers and AI agents often present valid proofs that silently answer a different question than the one the change requires: a green test suite over skipped tests, a reproduction from a different caller, a self-review blind to its own prose, or a ruling resting on an untested premise. This Skill forces you to name what your evidence does NOT cover before calling something proven. ## Core Features & Use Cases - Premise Auditing: Separates asserted premises from verified facts at delegation time, requiring each premise to be marked VERIFIED or ASSUMED. - Independent Reader Enforcement: Applies the rule that verifier and verified must not share the same reader, author, frame, or question set, turning comment assertions into load-bearing tests. - Surface-Matched Proof: Detects when a by-construction argument covers the wrong provider, config, or platform, and requires skipped tests to execute-and-pass by name with a dropping skip count. - Caller-Faithful Reproduction: Distinguishes observing the system produce a failure from reproducing a look-alike error with a hand-run query, demanding instrumentation before fixes. - Use Case: Before merging a Postgres-only change validated by a green SQLite suite, use this Skill to identify that the proof ran on the wrong surface and require the opt-in real-Postgres facts to execute and pass by name. ## Quick Start Ask the AI to review your proof or root-cause analysis using the proof-covers-the-wrong-thing checklist and state in one sentence what the evidence does not cover.

Frequently Asked Questions about proof-covers-the-wrong-thing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify a bug fix when my test suite is green?▼

Check whether the relevant tests actually executed rather than being skipped. A green suite with the pertinent facts skipped is green over a blind spot, so require the skip count to drop and each un-skipped test to appear by name in the passed list.

How to do a root cause analysis that does not chase the wrong error?▼

Observe the failure in the failing component's own output before fixing anything. A hand-run query or second client is a different caller than the code and reproduces its own error, so the first deliverable is instrumentation that makes the real cause observable.

Why is self review of code comments unreliable?▼

The author reads their intent back out of their prose regardless of what the code says, which is structural rather than a competence gap. The verifier and verified must not be the same reader or author, so convert load-bearing comment guarantees into tests that fail when the code stops delivering them.

When is a by-construction argument not enough proof?▼

When the change is provider-, config-, or platform-specific and the argument reasons about a different surface. The proof must run on the surface the change touches; a valid argument about an unchanged surface never substitutes for coverage of the changed one.

What are the limitations of reproducing a bug manually?▼

Manual reproduction with tools like psql produces a plausible related error, not necessarily the system's error. Reproducing a matching symptom is not observing the system produce it, so label behavior-preserving guards honestly as regression guards rather than fixes.