clean-data

Automate data cleaning for CRISP-DM 3.2 workflows with notebooks and summaries.

Updated Mar 20, 2026
One-click install
npx skills add https://github.com/thbraet/claude-template --skill clean-data-thbraet
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: clean-data
Source: https://github.com/thbraet/claude-template/tree/main/skills/clean-data
Command: npx skills add https://github.com/thbraet/claude-template --skill clean-data-thbraet

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill raises data quality to the level required by the selected analysis techniques. It addresses missing values, outliers, noise, encoding errors, and type corrections, while documenting every cleaning decision with rationale and impact. It produces a structured data cleaning report and organizes outputs to CRISP-DM 3.2 standards.

Core Features & Use Cases

  • Implements a complete data cleaning workflow aligned with CRISP-DM 3.2, including a Cleaning Plan, Missing Value Treatment, Outlier & Noise Treatment, and a Cleaning Log.
  • Produces two artifacts: a Jupyter notebook (notebooks/3.2-clean-data.ipynb) and a concise summary document (docs/crisp-dm/3-data-preparation/3.2-clean-data.md) for governance and auditability.
  • Supports reproducibility by logging steps, ensuring raw data is not modified, and fitting imputation models on training data only.

Quick Start

Run the clean-data workflow to produce notebooks/3.2-clean-data.ipynb and docs/crisp-dm/3-data-preparation/3.2-clean-data.md.

Frequently Asked Questions about clean-data

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate end-to-end data cleaning for missing values and outliers?

Automating end-to-end data cleaning handles missing values, outliers, encoding errors, and duplicates while producing a Jupyter notebook and a structured markdown summary documenting every operation for auditability.

What is the best way to prepare datasets for CRISP-DM 3.2 data preparation tasks?

Preparing datasets for CRISP-DM 3.2 involves executing a complete cleaning workflow that generates a reproducible notebook and a concise summary document stored at docs/crisp-dm/3-data-preparation/3.2-clean-data.md.

How does imputation work to prevent data leakage during data preparation?

Imputation prevents data leakage by fitting imputation models exclusively on training data, ensuring that all missing value treatments are learned before being applied to validation or test sets.

Can I preserve my raw dataset while applying missing value treatment and outlier removal?

Yes, data cleaning preserves raw data by logging all operations and storing cleaned outputs separately as artifacts, ensuring the original dataset remains unmodified throughout the preparation process.

What limitations exist when handling encoding errors and type corrections in notebooks?

Handling encoding errors and type corrections requires fitting imputation models on training data only, limiting transformations to learned parameters to maintain reproducibility and prevent data leakage across workflow stages.