text-normalization-and-large-file-processing

Normalize numeric prefixes and extract Chinese characters from Excel data.

110|3|Updated Feb 26, 2026
One-click install
npx skills add https://github.com/MichaelYang-lyx/AIDABench --skill text-normalization-and-large-file-processing-michaelyang-lyx
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: text-normalization-and-large-file-processing
Source: https://github.com/MichaelYang-lyx/AIDABench/tree/main/skills/sn-da-excel-workflow/capability/excel-data-cleaning/text-normalization
Command: npx skills add https://github.com/MichaelYang-lyx/AIDABench --skill text-normalization-and-large-file-processing-michaelyang-lyx

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Excel data often contains values with abnormal numeric prefixes and non-Chinese text that clutter analysis. This Skill normalizes such fields by stripping prefixes and extracting only Chinese characters, producing a clean, machine-friendly Excel file and a downloadable link.

Core Features & Use Cases

  • Normalize numeric fields by removing common prefixes (., I , ■ , 一 , _, . ) and converting to integers when possible.
  • Extract only Unicode Chinese characters from text columns, ensuring consistent linguistic data.
  • Save the cleaned dataset as an Excel file and provide a downloadable link, with memory cleanup for large files.

Quick Start

Run the text-normalization workflow on your Excel file and download the cleaned output.

Frequently Asked Questions about text-normalization-and-large-file-processing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I clean Excel data by removing abnormal prefixes from numeric fields?

To clean Excel data, this Skill normalizes numeric fields by stripping common prefixes like dots, underscores, and symbols, then converting the remaining values to integers. It processes your spreadsheet and outputs a cleaned Excel file with a downloadable link.

How do I extract only Chinese characters from a text column in pandas?

To extract only Chinese characters from pandas text columns, this Skill filters for Unicode Chinese characters specifically. It isolates the Chinese text from cluttered strings, ensuring your dataset contains consistent linguistic data for analysis.

Can I use pandas to normalize large Excel spreadsheets without running out of memory?

Yes, you can normalize large Excel spreadsheets with pandas using this Skill. It applies in-memory cleanup after processing to handle large files efficiently, producing a cleaned Excel file saved to disk for download.

What is the best way to automate text normalization for mixed Chinese and numeric data?

The best way to automate text normalization for mixed data is using Python libraries like re, numpy, and pandas. This Skill combines them to strip prefixes from numerics and extract Chinese characters from text in one workflow.

Does this data cleaning workflow handle special characters like symbols and underscores in Excel?

Yes, this data cleaning workflow handles special characters in Excel by removing common prefixes including dots, underscores, and symbols like squares. It normalizes these fields to produce a clean, machine-friendly Excel file for analysis.

Why are my numeric fields not converting to integers when cleaning Excel data?

Numeric fields fail to convert to integers during Excel data cleaning when abnormal prefixes like symbols or underscores are present. This Skill strips these prefixes first, allowing successful conversion to integers for a cleaned dataset.