verify-against-reality

Validates code changes by running them against live environments and re-reading state.

Updated Aug 5, 2026
One-click install
npx skills add https://github.com/amirbiron/claude-skills --skill verify-against-reality-amirbiron
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: verify-against-reality
Source: https://github.com/amirbiron/claude-skills/tree/main/skills/verify-against-reality
Command: npx skills add https://github.com/amirbiron/claude-skills --skill verify-against-reality-amirbiron

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Code that matches its documentation can still fail in production: the spec is not the consumer, test layers do not enforce what browsers enforce, concurrency bugs hide from sequential calls, and tests that cannot fail produce false confidence. This Skill closes the gap between "correct on paper" and "actually works" by requiring real execution and state re-verification before declaring anything done. ## Core Features & Use Cases - Reality-based verification: Run flows exactly as the real consumer runs them (e.g., claude.ai, Telegram, Meta Graph API) rather than as the spec describes, and read the other side's logs. - Write verification via state re-reads: Treat a write call's return value as receipt of the request, not proof of the result; confirm every write, send, or delete by reading the state back. - Falsifiable tests: Require every test to have a failure scenario, and run bug-fix tests against the old code to watch them fail before trusting them. - Use Case: After fixing an endpoint bug, run the flow with curl against the live service, re-read the stored state to confirm the change, and execute the new regression test on the pre-fix code to prove it catches the bug. ## Quick Start Verify that the fix you just made actually works by running the flow end-to-end against the live service and re-reading the resulting state.

Frequently Asked Questions about verify-against-reality

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify a bug fix actually works?

Run the flow end-to-end against the live service, not just in-process tests. Then run the new regression test against the pre-fix code and confirm it fails; a test that never saw the bug is not evidence of the fix.

How do I test that a write operation succeeded?

Verify writes by re-reading the state afterward, not by trusting the return value. An ok response only means the request was received; reading the file, record, or resource back proves the change actually happened.

Why do server tests pass but the browser feature fails?

Test layers like httpx do not enforce what browsers enforce, such as CSP, SameSite cookies, and CORS. Environment-level constraints must be verified in the environment itself, for example with a Playwright run in Chromium.

How do I test concurrent or async code correctly?

Test concurrency with asyncio.gather rather than sequential calls, since sequential calls pass even on broken code. Blocking behavior like synchronous pymongo inside an async handler only surfaces under parallel execution.

When should I skip runtime verification?

Skip it for read-only code with no side effects, pure refactors that change no behavior, planning or spec phases where nothing runs yet, or when speed was explicitly requested over verification.