strategy-verification

What problem does it solve?

Strategy verification solves the problem of untrustworthy performance claims by ensuring that reported results trace back to verifiable data and that no artifacts (replays, synthetic depth, or statistical tricks) inflate performance. It is used after scoring runs and before promotion decisions, and during autoresearch loops to filter noise from signal.

Core Features & Use Cases

• Data-quality checks to verify input data integrity and prevent replay or data artifacts from skewing results.
• Replay integrity and determinism checks to ensure outputs are reproducible and not inflated by time-travel or depth fabrication.
• Statistical confidence interpretation and integration with tear sheets to assess evidence grade, edge margin, sample adequacy, and recovery burden.
• Cross-checks and drift monitoring between scorer and live execution to catch divergences and regime shifts.
• Output a structured verification report with a clear verdict and actionable self-flags for ongoing governance.

Quick Start

Use this skill by providing the score output and the raw data file, then run the verification to generate a report.