data-cleansing

Clean and standardize messy datasets using pandas and numpy.

Updated Feb 7, 2026
Ready to run
npx skills add https://github.com/root-5/agentic-ml-pipeline --skill data-cleansing
💬 Prompt for ChatGPT / Claude Chatâ–Œ
Please help me install this Agent Skill.
Skill: data-cleansing
Source: https://github.com/root-5/agentic-ml-pipeline/tree/main/skills/data-cleaning
Command: npx skills add https://github.com/root-5/agentic-ml-pipeline --skill data-cleansing

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

分析やモデリングに適した圢匏にデヌタを敎圢・クリヌニングする。

Core Features & Use Cases

  • 欠損倀凊理: 削陀、平均倀/䞭倮倀補完、予枬モデルによる補完など。
  • 異垞倀凊理: クリッピング、陀去、倉換。
  • デヌタ型倉換: カテゎリ倉数の適切な型倉換、日付型のパヌス。
  • 重耇排陀: 重耇レコヌドの確認ず削陀。
  • 䞀貫性チェック: 衚蚘ゆれの統䞀、論理的矛盟の解消。

Quick Start

Run the data cleaning module on your dataset to produce a cleaned, analysis-ready file.

Frequently Asked Questions about data-cleansing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I handle missing values and outliers in pandas for analysis-ready data?▌

To handle missing values and outliers for analysis-ready data, this Skill applies pandas-based deletion, mean or median imputation, and clipping or transformation to standardize messy datasets deterministically.

What is the best way to clean inconsistent data formats and remove duplicate records?▌

The best way to clean inconsistent data formats and remove duplicates is by running type conversions, parsing dates, standardizing notation variations, and performing deduplication checks to resolve logical inconsistencies across pipelines.

Can I use this data cleaning approach for categorical variable conversion and date parsing?▌

Yes, you can use this data cleaning approach for categorical variable conversion and date parsing, as it specifically handles type conversions to ensure datasets are properly formatted for downstream analysis.

Does this data cleansing process produce reusable preprocessing modules or just cleaned data outputs?▌

This data cleansing process produces both reusable preprocessing modules and cleaned data outputs, relying on pandas and numpy to deliver deterministic preprocessing results for your analysis-ready pipelines.

When should I use an automated data cleaning pipeline instead of manual pandas transformations?▌

You should use an automated data cleaning pipeline instead of manual pandas transformations when you need deterministic preprocessing that consistently handles missing values, outliers, and deduplication across common data pipelines.