remote_formatter
OfficialEfficiently load and format datasets from HuggingFace Hub.
Authorcas-bigdatalab
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill automates the process of loading datasets from HuggingFace Hub, streamlining data preparation for analysis and model training.
Core Features & Use Cases
- Dataset Loading: Automatically download and load datasets from HuggingFace Hub.
- Data Formatting: Convert datasets into JSONL format for easy integration with other tools.
- Use Case: For data scientists and AI engineers who need to quickly access and prepare datasets for machine learning tasks.
Quick Start
Load the 'rotten_tomatoes' dataset from HuggingFace Hub and format it as JSONL:
python scripts/run_remote_formatter.py --dataset_path "rotten_tomatoes" --output_path /path/to/output.jsonl
Dependency Matrix
Required Modules
data_juicer
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: remote_formatter Download link: https://github.com/cas-bigdatalab/piflow/archive/main.zip#remote-formatter Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.