strategy-validation

Validates trading strategies via backtest tear-sheets, walk-forward optimization, Monte Carlo stress tests, and sensitivity analysis.

10|2|Updated Mar 8, 2026
One-click install
npx skills add https://github.com/mahmoud20138/Tradecraft --skill strategy-validation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: strategy-validation
Source: https://github.com/mahmoud20138/Tradecraft/tree/main/plugins/tradecraft/skills/strategy-validation
Command: npx skills add https://github.com/mahmoud20138/Tradecraft --skill strategy-validation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

End-to-end validation of trading strategies through a reproducible pipeline that combines backtesting tearsheets, walk-forward optimization, Monte Carlo stress testing, and parameter sensitivity with A/B testing to ensure robustness and generalization across market regimes.

Core Features & Use Cases

  • Backtest Tearsheet generation with metrics like Sharpe, Sortino, Calmar, VaR, and CVaR to quantify performance.
  • Walk-Forward Optimization (anchored and rolling) to evaluate out-of-sample stability and parameter robustness.
  • Monte Carlo Stress Testing to stress portfolio paths and estimate distribution of outcomes.
  • Parameter Sensitivity analysis including grid sweeps and robustness checks to identify stable parameter regions.
  • Strategy A/B Testing to compare variants using statistical tests and practical significance.

Quick Start

Run the strategy validation workflow against historical data to generate a comprehensive report.

Frequently Asked Questions about strategy-validation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate a trading strategy for robustness and production readiness?

You validate a trading strategy for production readiness by running backtest tearsheets, walk-forward optimization, Monte Carlo simulations, and parameter sensitivity A/B testing to ensure robustness and generalization across market regimes.

What is walk-forward optimization used for in out-of-sample backtesting?

Walk-forward optimization is used to evaluate out-of-sample stability and parameter robustness by applying anchored or rolling windows, ensuring that your strategy generalizes well to unseen market data rather than overfitting historical trends.

How do I perform Monte Carlo stress testing on portfolio paths?

You perform Monte Carlo stress testing to stress portfolio paths and estimate the distribution of outcomes, which helps quantify the probability of extreme drawdowns and assess the statistical reliability of your strategy's performance.

Can I run A/B testing to compare different trading strategy variants?

Yes, you can run strategy A/B testing to compare variants using statistical tests and practical significance, allowing you to determine whether performance differences between strategy configurations are meaningful rather than just statistical noise.

What metrics are enforced to ensure trading strategy production readiness?

The validation pipeline enforces metrics like Sharpe, Sortino, Calmar, VaR, and CVaR alongside robustness thresholds to quantify performance and ensure that your trading strategy meets strict production readiness criteria.

How do I check parameter sensitivity and stability for a trading strategy?

You check parameter sensitivity and stability through grid sweeps and parameter perturbation analyses, which identify stable parameter regions and reveal whether your strategy's performance is highly dependent on specific input values.