verify-production

Validate deployed PRs in production by tracing code changes and querying logs for emitted signals.

Updated May 2, 2024
One-click install
npx skills add https://github.com/cman131/EatSomethingSourWhenYoureTired --skill verify-production-cman131
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: verify-production
Source: https://github.com/cman131/EatSomethingSourWhenYoureTired/tree/main/.claude/skills/verify-production
Command: npx skills add https://github.com/cman131/EatSomethingSourWhenYoureTired --skill verify-production-cman131

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? After merging a PR, teams often lack a systematic way to confirm the change actually works in production. This Skill closes that gap by tracing the PR's code changes to the log signals they emit, querying production logs for those signals, and surfacing admin/support endpoints to verify state. ## Core Features & Use Cases - Work item ↔ PR resolution: Accepts a work item ID, PR ID, or URL and resolves the linked counterpart via GitHub Issues tools. - Change classification and signal mapping: Reads the PR diff, classifies changed files (controllers, services, data access, clients), and extracts entry points, log message templates, downstream calls, and data writes. - Tiered log verification: Runs scoped grep-based queries against console/local logs in four tiers — endpoint hits, new log emissions, errors from new code, and cross-service dependency checks — then compiles a structured verification report. - Use Case: After deploying a story that adds a new API endpoint, provide the PR number; the Skill identifies the new route and log statements, asks for a scoping identifier, queries the last 2 days of logs, and reports whether the endpoint was exercised cleanly. ## Quick Start Verify that PR 1234 is behaving correctly in production by checking its log signals over the past two days.

Frequently Asked Questions about verify-production

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify a PR is working in production after deployment?▼

Provide the PR ID or linked work item ID. The Skill reads the PR diff, extracts new entry points and log message templates, then queries production logs in tiers — endpoint hits, new log emissions, and errors — to confirm the code ran.

How to trace code changes to production log signals?▼

The Skill classifies each changed file (controller, service, data access, client), reads non-test files, and records every logging call's level and exact message template. These templates become the grep patterns used to search application logs.

What inputs does production deployment verification need?▼

It accepts a work item ID, a PR ID, or a full URL for either, and resolves the missing counterpart automatically. Before querying logs, it also requires a scoping identifier such as a tenant ID, time window, or entity ID.

Does this work with centralized log platforms like Datadog or Splunk?▼

This Skill is configured for console/local logs queried with grep, not a centralized platform. The log query rules and reference section can be adapted to map the same tiered query strategy onto your platform's query syntax.

Why does the Skill ask for a scoping identifier before querying logs?▼

Unscoped log queries blow up context and rarely answer the verification question. A tenant ID, time window, or entity ID narrows results to events that actually exercised the deployed change.

What are the limitations of log-based production verification?▼

It can only confirm signals the code actually emits; unlogged branches, such as an error path never triggered, remain unverified. Unobservable third-party dependencies require checking that dependency's own platform logs for root cause.