Filter structured data rows by character and line count thresholds.
npx skills add https://github.com/cas-bigdatalab/piflow --skill lowinfo-filter
Please help me install this Agent Skill. Skill: lowinfo_filter Source: https://github.com/cas-bigdatalab/piflow/tree/main/workspace/skills/lowinfo_filter Command: npx skills add https://github.com/cas-bigdatalab/piflow --skill lowinfo-filter
This Skill helps users filter out low information content from structured data files, improving data quality and efficiency.
Run the lowinfo_filter skill with the following command:
python scripts/lowinfo_filter.py \
--input_path <input_file> \
--output_path <output_file> \
--min_chars 10 --max_chars 2000 \
--min_lines 1 --max_lines 200
High-intent search queries and answers about installing and using this skill.
This Skill filters structured data files by evaluating the character and line counts of specified text columns. It removes rows that fall outside your defined minimum and maximum thresholds.
Yes, this Skill uses pandas to remove low information content from Excel files. It evaluates specified text columns and filters out rows with insufficient content across CSV, TSV, and Excel formats.
The best way to clean structured data by removing short text entries is to apply character and line count thresholds. This Skill processes structured files to drop rows failing your specified content length criteria.
Yes, this data filtering method supports setting both minimum and maximum line limits. You can configure the script with min_lines and max_lines arguments to exclude rows that exceed or fall below your thresholds.
To prepare structured data files for content quality filtering, ensure your datasets are in CSV, TSV, or Excel format with defined text columns. You need pandas installed to run the filtering script and process the data manipulation.
cas-bigdatalabRemove rows or columns with missing values from CSV, TSV, Excel, JSON, and JSONL files.
jasrajtulsiParse FCS 2.0-3.1 cytometry files into event arrays and metadata.
auldsyababuaAutomate missing-value analysis, imputation, and Plotly Dash dashboard generation for CSV datasets.
jamesbrookscoConvert Karakeep bookmark content into vector embeddings for semantic search.