skills.rest
xingwudao
xingwudaoCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

monitor-strategy-run

Audit open-xquant backtest runs and generate integrity reports.

116|38|Updated Feb 26, 2026
Search Tags:#experiment logging#robustness testing#open-xquant#backtest validation#quant strategy audit#reproducibility check#run integrity
One-click install
npx skills add https://github.com/xingwudao/open-xquant --skill monitor-strategy-run
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: monitor-strategy-run
Source: https://github.com/xingwudao/open-xquant/tree/main/agent/skills/monitor-strategy-run
Command: npx skills add https://github.com/xingwudao/open-xquant --skill monitor-strategy-run

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates the risk of relying on unvalidated, non-reproducible quant strategy backtest runs that lack proper audit trails, ensuring only trustworthy, compliant research results are used for decision-making.

Core Features & Use Cases

  • Run Artifact Validation: Verifies that run directories contain all required audited artifacts and passes schema validation for spec and runtime audit files.
  • Automated Audit Execution: Runs reproducibility, research bias, and robustness checks via the open-xquant CLI to flag critical issues like hash mismatches, survivorship risk, or parameter fragility.
  • Experiment Logging & Reporting: Registers verified runs to the central experiment log and supports generating structured research reports with full audit context and warning disclosures. Use Case: A quant researcher who just completed a backtest can use this Skill to automatically validate all run artifacts, run all required audits, and generate a compliant research report with all findings documented, without manually running individual CLI commands.

Quick Start

Use the monitor-strategy-run skill to audit the completed backtest run with ID 'run_20240520_001' and generate a full integrity report including all audit and robustness findings.

Frequently Asked Questions about monitor-strategy-run

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate quant strategy backtest run artifacts for reproducibility?▼

You can audit completed backtest runs by providing the specific run ID, such as 'run_20240520_001', to the Skill. It automatically runs reproducibility checks, research bias audits, and robustness testing via the open-xquant CLI without manual command execution.

What is backtest validation and when do I need to audit research bias?▼

Backtest validation is the process of verifying the integrity and reproducibility of quant strategy runs. You need to audit research bias when evaluating backtest results to flag critical issues like survivorship risk, preventing reliance on unvetted research outcomes.

Does the open-xquant framework support automated experiment logging and robustness testing?▼

Yes, the open-xquant framework supports automated experiment logging and robustness testing. The Skill executes open-xquant CLI commands to run parameter fragility checks and registers verified runs to a central experiment log for compliant research reporting.

What happens if a backtest run has missing runtime audits or hash mismatches?▼

If a backtest run has missing runtime audits or hash mismatches, the Skill enforces strict guardrails by rejecting the run. This schema validation ensures that incomplete or inconsistent runs are flagged and excluded from the experiment log.

How to generate a structured research report with full audit context and warning disclosures?▼

To generate a structured research report with full audit context, the Skill compiles all reproducibility, research bias, and robustness findings. It mandates the inclusion of all audit warnings in the final report, ensuring complete transparency of run integrity.

Related Skills

Explore More Finance & Accounting Skills→
xingwudaoxingwudao
116

run-authorized-backtest

Execute authorized quant backtests with provenance tracking and post-run validation.

Community
Advanced
xingwudaoxingwudao
116

write-research-report

Generate HTML research reports from validated open-xquant experiment artifacts.

Community
Advanced
xingwudaoxingwudao
116

create-signal

Create validated trading signal components for the open-xquant kernel.

Community
Intermediate
xingwudaoxingwudao
116

plot-indicators

Generates charts of indicator overlays and price data from oxq run results.

Community
Intermediate