review-upgrade-compatibility-and-test-determinism

What problem does it solve?

This Skill eliminates the risk of production outages, data corruption, and flaky test suites caused by unvetted compatibility gaps and test determinism issues in behavior-changing pull requests, ensuring safe rolling upgrades and rollbacks for services and distributed systems.

Core Features & Use Cases

• Compatibility Surface Scoping: Automatically identifies changed API contracts, protocol payloads, storage formats, config keys, migration scripts, and release docs that impact compatibility.
• Full Checklist Validation: Runs a comprehensive pass of compatibility and test determinism checks, including backward/forward compatibility, migration safety, mixed-version cluster behavior, and deterministic test design.
• Severity-Graded Findings: Assigns clear severity levels (Blocker, Major, Minor, Info) to each identified risk with concrete evidence and change requests, then hands off to the standardized output formatting skill.
• Use Case: Engineering teams shipping services with rolling upgrade requirements can use this Skill to review PRs that modify APIs, schemas, or migration logic to catch high-risk compatibility gaps and flaky test patterns before they reach production.

Quick Start

Use this skill to review the provided pull request diff for the user service schema changes to identify backward compatibility gaps and non-deterministic test patterns prior to merge.