data_splitter

Official

Efficiently split JSONL datasets into subsets with specified ratios.

Authorcas-bigdatalab
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill simplifies the process of splitting JSONL datasets into smaller subsets based on specified ratios, making it easier to manage and analyze data.

Core Features & Use Cases

  • JSONL Splitting: Divide JSONL data into multiple subsets based on given ratios.
  • Random Splitting: Support random splitting for better data distribution.
  • Stratified Splitting: Maintain category distribution when splitting by a specific field.
  • Use Case: For data scientists who need to create training, validation, and test sets from a large JSONL dataset.

Quick Start

Use the data_splitter skill to split the 'data.jsonl' file into training, validation, and test sets with ratios 0.7, 0.2, and 0.1 respectively.

Dependency Matrix

Required Modules

None required

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: data_splitter
Download link: https://github.com/cas-bigdatalab/piflow/archive/main.zip#data-splitter

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.