data-cleaner

Clean and preprocess CSV and Excel datasets for MCM/ICM modeling workflows.

Updated Jan 26, 2026
One-click install
npx skills add https://github.com/SPIRAL-EDWIN/MCM-ICM-2601000 --skill data-cleaner-spiral-edwin
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-cleaner
Source: https://github.com/SPIRAL-EDWIN/MCM-ICM-2601000/tree/main/.github/skills/data-cleaner
Command: npx skills add https://github.com/SPIRAL-EDWIN/MCM-ICM-2601000 --skill data-cleaner-spiral-edwin

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Data quality is foundational for effective modeling; messy CSV/Excel inputs cause biased results and wasted time. The Data-Cleaner standardizes loading, inspecting, and cleaning datasets to ensure reproducible inputs for analytics and modeling.

Core Features & Use Cases

  • Load and inspect data from common formats (CSV, Excel, JSON) and show shape, dtypes, missing values, and basic statistics.
  • Handle missing values with robust strategies (auto, median, forward-fill, interpolate) and drop heavily incomplete columns.
  • Detect and cap or remove outliers using IQR or Z-score methods.
  • Normalize numeric features with standard, min-max, or robust scaling.
  • Fix data types (dates to datetime, categoricals) to improve downstream analysis.
  • Produce a cleaned dataset (processed.csv) and a cleaning report (where the pipeline decisions are documented).

Quick Start

To start, run the cleaning pipeline on your raw data file: clean_data(filepath='data/raw_data.csv', output_path='data/processed.csv', normalize=False). Then review the generated processed.csv and processed_report.json to confirm improvements.

Frequently Asked Questions about data-cleaner

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I handle missing values and outliers in a CSV dataset for modeling?

Handling missing values and outliers in a CSV dataset involves applying imputation strategies like median, forward-fill, or interpolation, and using IQR or Z-score methods to cap or remove outliers. This process standardizes raw inputs and produces a clean dataset for modeling.

What is the best way to normalize numeric features and fix data types during preprocessing?

The best way to normalize numeric features during preprocessing is to apply standard, min-max, or robust scaling, while fixing data types by converting dates to datetime formats and categoricals. This standardization improves downstream analysis and produces a consistent dataset.

Can I use this data cleaning pipeline on Excel and JSON files?

Yes, you can use this data cleaning pipeline on Excel and JSON files. It loads and inspects data from common formats like CSV, Excel, and JSON, showing shape, dtypes, and basic statistics before applying imputation, outlier handling, and normalization.

How do I automate data cleaning and generate a quality report for tabular data?

You automate data cleaning for tabular data by running a pipeline that loads raw files, imputes gaps, handles outliers, standardizes formats, and outputs a cleaned dataset. It automatically produces a processed CSV and a JSON quality report documenting all pipeline decisions.

Does data normalization happen automatically when preprocessing raw data?

Data normalization does not happen automatically by default; it is controlled via a parameter. You can explicitly enable standard, min-max, or robust scaling for numeric features during preprocessing to ensure your cleaned dataset meets specific modeling requirements.