god-data-cleaning

Automating data preprocessing for machine learning involves handling missing values, outliers, and data types. This Skill streamlines that process by combining domain-knowledge feature construction, numerical scaling, and categorical encoding into a single pipeline.

Yes, Pandera and Great Expectations can be used together for schema validation during data preprocessing. This Skill leverages both frameworks to enforce data quality checks and validate schemas before feeding datasets into machine learning models.

Yes, this data preparation tool supports time series preprocessing and stationarity checks. It applies time-based data transformations to ensure temporal datasets are correctly formatted and conditioned for machine learning models.

Preprocessing large datasets with Polars and PySpark involves efficient data cleaning and feature engineering. This Skill integrates both frameworks to handle missing values and construct features at scale, preparing high-quality inputs for AI workflows.

Yes, pandas and scikit-learn are required dependencies to run the clean_data command. The Skill relies on these libraries alongside Polars, PySpark, NumPy, Great Expectations, and Pandera to execute its full data preparation pipeline.

Machine learning models often perform poorly when data cleaning lacks interaction features and categorical encoding. This Skill addresses this by applying domain-knowledge feature engineering and numerical scaling to improve overall data quality.