strategy-verification

Verify trading strategy performance by cross-checking scorer outputs, data quality reports, and tear-sheets into a structured verdict report.

1|Updated Apr 28, 2026
One-click install
npx skills add https://github.com/recallnet/polymarket-cross-sectional-momentum --skill strategy-verification
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: strategy-verification
Source: https://github.com/recallnet/polymarket-cross-sectional-momentum/tree/main/.agents/skills/strategy-verification
Command: npx skills add https://github.com/recallnet/polymarket-cross-sectional-momentum --skill strategy-verification

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Strategy verification solves the problem of untrustworthy performance claims by ensuring that reported results trace back to verifiable data and that no artifacts (replays, synthetic depth, or statistical tricks) inflate performance. It is used after scoring runs and before promotion decisions, and during autoresearch loops to filter noise from signal.

Core Features & Use Cases

  • Data-quality checks to verify input data integrity and prevent replay or data artifacts from skewing results.
  • Replay integrity and determinism checks to ensure outputs are reproducible and not inflated by time-travel or depth fabrication.
  • Statistical confidence interpretation and integration with tear sheets to assess evidence grade, edge margin, sample adequacy, and recovery burden.
  • Cross-checks and drift monitoring between scorer and live execution to catch divergences and regime shifts.
  • Output a structured verification report with a clear verdict and actionable self-flags for ongoing governance.

Quick Start

Use this skill by providing the score output and the raw data file, then run the verification to generate a report.

Frequently Asked Questions about strategy-verification

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify backtesting results before go-live decisions?

Verify backtesting results by cross-checking score outputs, data-quality reports, and tear sheets against raw data. This process detects replay artifacts and statistical tricks to confirm performance is real before go-live.

What is strategy verification and when do I need it?

Strategy verification confirms that reported performance traces to verifiable data without inflated artifacts. You need it after scoring runs and before promotion decisions, or during autoresearch loops to filter noise from signal.

How do I check for replay integrity and data quality in backtesting?

Check replay integrity by running determinism checks to ensure outputs are reproducible and not inflated by time-travel or synthetic depth. Data-quality checks verify input data integrity to prevent replay artifacts from skewing results.

How do I monitor drift between scorer and live execution data?

Monitor scorer and live execution drift by running cross-checks to catch divergences and regime shifts. Post-score drift checks compare scorer outputs against live data to identify performance inconsistencies over time.

Can I use tear sheets to assess statistical confidence in trading strategies?

Yes, integrate tear sheets to assess statistical confidence by evaluating evidence grade, edge margin, sample adequacy, and recovery burden. This interpretation helps determine if the strategy edge is statistically significant.

What is included in a structured strategy verification report?

A structured verification report includes a clear verdict on performance reality and actionable self-flags for ongoing governance. It synthesizes score outputs, data-quality checks, and statistical interpretations into actionable insights.