data-juicer-card
OfficialEfficiently clean and preprocess datasets with Data-Juicer.
AuthorEurecaMoment
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill simplifies the process of dataset cleaning, filtering, normalization, deduplication, and quality control, enabling reproducible data processing with Data-Juicer.
Core Features & Use Cases
- Dataset Cleaning: Handle tasks like HTML tag removal, URL filtering, and text length adjustment.
- Data Filtering: Filter text based on character length and word count.
- Use Case: When preparing a dataset for analysis or benchmarking, this Skill can help ensure the data is clean and standardized.
Quick Start
Clean the dataset at the path '/path/to/input.jsonl' and save the results to '/path/to/output/cleaned.jsonl'.
Dependency Matrix
Required Modules
data_juicer
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: data-juicer-card Download link: https://github.com/EurecaMoment/BenchClaw/archive/main.zip#data-juicer-card Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.