invalid-data-cleaning

Clean large Excel data with conditional Parquet conversion and regex text cleaning.

110|3|Updated Feb 26, 2026
One-click install
npx skills add https://github.com/MichaelYang-lyx/AIDABench --skill invalid-data-cleaning-michaelyang-lyx
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: invalid-data-cleaning
Source: https://github.com/MichaelYang-lyx/AIDABench/tree/main/skills/sn-da-excel-workflow/capability/excel-data-cleaning/invalid-data-cleaning
Command: npx skills add https://github.com/MichaelYang-lyx/AIDABench --skill invalid-data-cleaning-michaelyang-lyx

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill enables scalable preprocessing of large Excel datasets by first assessing total row count to decide whether to convert to Parquet for faster I/O, then cleaning a specified text column with a regex to keep Chinese characters, and finally exporting the cleaned data to an Excel file with a downloadable link.

Core Features & Use Cases

  • Parquet conversion for large data: If the dataset exceeds a threshold, convert all sheets from the Excel file to a Parquet file to improve read/write performance.
  • Text normalization with regex: Clean targeted text fields by preserving Chinese characters and removing special symbols or digits.
  • Export and download: Save the cleaned data as an .xlsx file and provide a local download link for easy access in reports or dashboards.

Quick Start

Place input_data.xlsx in the workflow directory and run the invalid-data-cleaning process to output cleaned_data.xlsx and a downloadable link.

Frequently Asked Questions about invalid-data-cleaning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I clean large Excel datasets with regex and optimize read/write performance?

To clean large Excel datasets, you can automate preprocessing by assessing the total row count and conditionally converting sheets to Parquet for faster I/O. This approach applies regex-based text cleaning to preserve Chinese characters and exports the final cleaned data to a downloadable Excel file.

What is Parquet conversion and when do I need it for Excel data preprocessing?

Parquet conversion is a process that transforms Excel sheets into a Parquet file format to improve read and write performance for large datasets. You need it for Excel data preprocessing when your dataset exceeds a specified row threshold, ensuring faster I/O during bulk cleaning tasks.

How do I remove special symbols and digits from text fields while keeping Chinese characters in Excel?

To remove special symbols and digits while keeping Chinese characters in Excel, apply a regex-based text normalization process to your specified text columns. This targeted cleaning mechanism preserves Chinese characters and strips away unwanted symbols across multi-sheet workflows.

Can I process multiple sheets in an Excel file for bulk text cleaning?

Yes, you can process multiple sheets in an Excel file for bulk text cleaning. The workflow assesses total row counts across sheets, conditionally converts them to Parquet for performance, applies regex text normalization, and exports all cleaned data back to Excel.

Does this Excel data cleaning workflow require any external dependencies or components?

No, this Excel data cleaning workflow does not require any external dependencies or components to operate. You simply place your input_data.xlsx file in the workflow directory and run the process to output cleaned_data.xlsx with a local download link.

What are the limitations of using regex for text cleaning in bulk Excel data?

A limitation of using regex for text cleaning in bulk Excel data is that it specifically targets text fields to preserve Chinese characters while removing special symbols and digits. It is designed for analytics, finance, and reporting preprocessing rather than complex semantic text extraction.