design-backtesting

What problem does it solve?

Design and codify a historical backtesting library that enables OS designers to calibrate and validate agent behaviors against past artifacts, ensuring output quality and reproducibility.

Core Features & Use Cases

• Identify backtestable skills from the OS skill designs and map required artifact types (inputs, outputs, and ground truth) for calibration.
• Define artifact types and ground truth definitions, enabling consistent comparison and traceability across OS iterations.
• Establish ordering schemes (date, importance, or outcome) and scoring rubrics to quantify OS improvements over time.
• Outline live reference integration, onboarding flow, and sequential backtesting to support continuous learning and governance.
• Use Case: Calibrate a new OS by comparing its top-3 skill outputs against historical artifacts and updating the design accordingly.

Quick Start

Generate the complete domain-input/backtesting-library.md following the steps outlined in this SKILL.