generate-test-design

Generate a CRISP-DM 4.2 test design with splitting strategy, metrics, and experiment tracking.

Updated Mar 20, 2026
One-click install
npx skills add https://github.com/thbraet/claude-template --skill generate-test-design
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: generate-test-design
Source: https://github.com/thbraet/claude-template/tree/main/skills/generate-test-design
Command: npx skills add https://github.com/thbraet/claude-template --skill generate-test-design

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill defines the experimental framework for model building: how data is split, how models are evaluated, what metrics matter, and how experiments are tracked to ensure rigorous, reproducible evaluation.

Core Features & Use Cases

  • Define train/validation/test splitting strategies and cross-validation approaches.
  • Specify evaluation metrics, baselines, and an experiment tracking plan to document results.
  • Produce artifacts: a Jupyter notebook at notebooks/4.2-test-design.ipynb and a summary doc at docs/crisp-dm/4-modeling/4.2-test-design.md.

Quick Start

Create the 4.2 test design notebook and the accompanying summary document following the outlined steps.

Frequently Asked Questions about generate-test-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a CRISP-DM test design for model evaluation?

To create a CRISP-DM test design, define your train/validation/test splitting strategies, specify evaluation metrics, and establish baselines to ensure reproducible model evaluation across experiments.

What should be included in a rigorous test design splitting strategy?

A rigorous splitting strategy requires clear train/validation/test splits, defined cross-validation approaches, and reproducibility criteria to ensure consistent model evaluation across experimental runs.

How do I document experiment tracking and baselines in a notebook?

Document experiment tracking and baselines by creating a Jupyter notebook at notebooks/4.2-test-design.ipynb and a summary doc at docs/crisp-dm/4-modeling/4.2-test-design.md to record results and artifacts.

Does this test design approach work for reproducible modeling projects?

Yes, this test design approach works for reproducible modeling projects by defining concrete requirements for artifacts, documentation paths, and reproducibility criteria across all data splits.

Why define train, validation, and test splits before model building?

Defining train, validation, and test splits before model building establishes the experimental framework, ensuring rigorous evaluation metrics and experiment tracking prevent biased model assessment.

What are the limitations of manual test design without experiment tracking?

Without experiment tracking, manual test designs lack reproducible evaluation across splits, clear baselines, and artifact documentation, compromising the rigor of the modeling project.