signal-validation

Validate trading signals with Wilson CI and binomial tests in Rust.

2|1|Updated Oct 4, 2025
One-click install
npx skills add https://github.com/andrew-starosciak/deep-algo --skill signal-validation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: signal-validation
Source: https://github.com/andrew-starosciak/deep-algo/tree/main/.claude/skills/signal-validation
Command: npx skills add https://github.com/andrew-starosciak/deep-algo --skill signal-validation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill provides a structured framework to validate trading signals using statistical methods before deployment, reducing the risk of live losses due to false signals.

Core Features & Use Cases

  • Hypothesis testing: Apply p-values to assess signal profitability with defined thresholds.
  • Confidence intervals: Use Wilson score intervals to quantify win-rate uncertainty.
  • Go/No-Go criteria: Predefine development and production readiness criteria (p-value, sample size, EV) to guide decisions.
  • Backtest & Walk-Forward: Evaluate signals across historical and out-of-sample data to detect overfitting.

Quick Start

Review the signal's data, run the validation routines to compute Wilson CI, binomial p-value, information coefficient, and conditional probability, then decide Go/No-Go based on predefined criteria.

Frequently Asked Questions about signal-validation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I statistically validate a trading signal before live deployment?

To statistically validate a trading signal, you can apply hypothesis testing and confidence intervals to historical trade data to compute p-values and assess profitability before live deployment.

What is a Wilson confidence interval and how does it quantify win-rate uncertainty?

A Wilson confidence interval quantifies win-rate uncertainty by calculating a score interval around your signal's historical trade outcomes, helping you determine if observed profitability is statistically significant or due to chance.

How do I use walk-forward analysis to detect overfitting in trading strategies?

Walk-forward analysis detects overfitting by evaluating trading signals across out-of-sample data, ensuring that the predictive power and performance outcomes hold up beyond the initial historical backtest data.

How do I set Go or No-Go criteria for production trading readiness?

You set Go/No-Go criteria by predefining thresholds for p-values, sample sizes, and expected value, then using binomial tests and conditional probability assessments to decide if a signal meets production readiness.

Does signal validation require any external statistical libraries or dependencies?

No external statistical libraries are required because this signal validation framework implements standard statistical routines natively in Rust, computing p-values and confidence intervals without any dependencies.

What is information coefficient and how does it measure trading signal predictive power?

Information coefficient measures trading signal predictive power by correlating predicted signal values with actual historical performance outcomes, providing a quantitative assessment of the signal's forecasting ability.