maximum_line_length_filter
OfficialFilter text samples by maximum line length
Authorcas-bigdatalab
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill helps manage and filter text samples based on their line length, ensuring that the text adheres to specific length constraints.
Core Features & Use Cases
- Line Length Filtering: Filters and processes text samples to maintain a specific range of line lengths.
- JSONL Format Support: Designed to work with JSON and JSONL formatted data, allowing for field-specific filtering.
- Use Case: Ideal for data preprocessing where maintaining a consistent line length is crucial, such as in log file analysis or text summarization.
Quick Start
Run the maximum_line_length_filter skill to filter text samples from 'input.jsonl' with a minimum length of 10 and a maximum length of 20, outputting to 'output.jsonl'.
Dependency Matrix
Required Modules
py-data-juicer
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: maximum_line_length_filter Download link: https://github.com/cas-bigdatalab/piflow/archive/main.zip#maximum-line-length-filter Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.