data_splitter
OfficialEfficiently split JSONL datasets into subsets with specified ratios.
Authorcas-bigdatalab
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill simplifies the process of splitting JSONL datasets into smaller subsets based on specified ratios, making it easier to manage and analyze data.
Core Features & Use Cases
- JSONL Splitting: Divide JSONL data into multiple subsets based on given ratios.
- Random Splitting: Support random splitting for better data distribution.
- Stratified Splitting: Maintain category distribution when splitting by a specific field.
- Use Case: For data scientists who need to create training, validation, and test sets from a large JSONL dataset.
Quick Start
Use the data_splitter skill to split the 'data.jsonl' file into training, validation, and test sets with ratios 0.7, 0.2, and 0.1 respectively.
Dependency Matrix
Required Modules
None requiredComponents
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: data_splitter Download link: https://github.com/cas-bigdatalab/piflow/archive/main.zip#data-splitter Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.