light-data-engineering

What problem does it solve?

This Skill helps teams enforce data quality and rapidly build clean, well-documented datasets for research and experimentation. It guides data cleaning, missing-value handling, feature engineering, dataset construction, and data-privacy-aware packaging.

Core Features & Use Cases

• Data health checks with data_doctor-style profiling and quality gates.
• Leakage-free data splitting, leakage checks, and robust preprocessing pipelines.
• Automatic generation of data cards and Croissant-compliant metadata for data sharing and reproducibility.

Quick Start

Run a complete data quality pass on a dataset with python scripts/data_doctor.py --csv your_data.csv --out quality_report.md