backtest-diagnose

Diagnose failed trading backtests by inspecting artifacts and signal_engine code.

30.4k|4.9k|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/HKUDS/Vibe-Trading --skill backtest-diagnose
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: backtest-diagnose
Source: https://github.com/HKUDS/Vibe-Trading/tree/main/agent/src/skills/backtest-diagnose
Command: npx skills add https://github.com/HKUDS/Vibe-Trading --skill backtest-diagnose

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

The backtest-diagnose skill helps trading engineers pinpoint why a backtest failed, raised errors, or produced suspect results by guiding them through artifact review, code examination, and root-cause classification before implementing targeted fixes.

Core Features & Use Cases

  • Structured Diagnostic Workflow: Step through artifact reading, code review, taxonomy-based issue classification, and fix verification with rerun validation.
  • Error Taxonomy Guidance: Differentiate between runtime, logic, and data errors and apply appropriate fixes while ignoring provider-side limitations.
  • Validation Rules & Hard Gates: Ensure metrics, trades, equity data, and exit codes meet quality gates while confirming signal_engine structure and rerunning backtests.
  • Use Case: Investigate a trading strategy that succeeds but yields zero trades to locate the offending signal logic or data assumption before recommitting capital.

Quick Start

Diagnose the latest failed backtest by examining artifacts and signal_engine code and suggest precise fixes following the hard gate checklist.

Frequently Asked Questions about backtest-diagnose

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I diagnose a trading backtest that ran successfully but produced zero trades?

Diagnosing a backtest with zero trades requires inspecting artifacts like metrics.csv and trades.csv alongside signal_engine.py code to locate offending signal logic or incorrect data assumptions. This structured workflow classifies root causes before applying targeted fixes.

What is the best way to find the root cause of a failed trading strategy backtest?

Finding a backtest failure root cause involves stepping through artifact reading, examining signal_engine.py code, classifying issues by error taxonomy, and verifying fixes through rerun validation. This structured workflow ensures precise corrective actions.

How do I fix runtime errors in my backtest when I have config.json and equity.csv available?

Fixing backtest runtime errors requires inspecting available artifacts like config.json and equity.csv, then reviewing signal_engine.py code to differentiate runtime, logic, and data errors. This taxonomy-based classification guides appropriate corrective actions.

Can I validate backtest fixes by rerunning the strategy after editing signal_engine.py?

You can validate backtest fixes by rerunning the strategy after editing signal_engine.py code. The diagnostic workflow includes validation rules and hard gates confirming metrics, trades, equity data, and exit codes meet quality requirements post-edit.

Why does my trading strategy backtest produce underperforming results despite no runtime errors?

Underperforming backtests without runtime errors often hide logic bugs or insufficient trade activity. Diagnosing these issues requires reviewing metrics.csv and trades.csv artifacts to identify suspect results and classify underlying logic or data errors.

What limitations should I be aware of when diagnosing backtest failures in a trading strategy?

When diagnosing backtest failures, note the workflow requires available artifacts and code for review including metrics.csv, equity.csv, trades.csv, config.json, and signal_engine.py. It also focuses on ignoring provider-side limitations during error taxonomy classification.