mixture_formatter
OfficialMix and merge multiple datasets for comprehensive data analysis.
Authorcas-bigdatalab
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill addresses the challenge of combining diverse datasets into a unified format for more powerful analysis and insights.
Core Features & Use Cases
- Dataset Merging: Combines samples from multiple datasets based on specified weights or equal distribution.
- Data Aggregation: Generates a new dataset that can be used for further analysis.
- Use Case: Ideal for data scientists who need to blend data from different sources to create a single, coherent dataset for analysis.
Quick Start
Run the mixture_formatter skill to merge data from 'dataset1.jsonl' and 'dataset2.jsonl' with equal weights, and output to 'output.jsonl'.
Dependency Matrix
Required Modules
data_juicer
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: mixture_formatter Download link: https://github.com/cas-bigdatalab/piflow/archive/main.zip#mixture-formatter Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.