dataset-download

Download and prepare CTR evaluation datasets into train/valid/test files.

2|Updated Apr 10, 2026
One-click install
npx skills add https://github.com/raoxuan98-hash/open_unimixer_skills --skill dataset-download
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dataset-download
Source: https://github.com/raoxuan98-hash/open_unimixer_skills/tree/main/.kimi/skills/dataset-download
Command: npx skills add https://github.com/raoxuan98-hash/open_unimixer_skills --skill dataset-download

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Many CTR model benchmarks require large, structured datasets that are cumbersome to obtain and organize; this skill streamlines downloading, extracting, and arranging datasets so experiments can run reproducibly.

Core Features & Use Cases

  • Multiple download methods: supports Git LFS cloning, direct ZIP downloads, and programmatic retrieval via the huggingface_hub API.
  • Standardized layout: ensures each dataset is placed under data/<dataset_name>/ with train.csv, valid.csv, and test.csv ready for FuxiCTR/BARS pipelines.
  • Integrity and verification tips: includes recommendations for md5 checks, file counts, and quick sanity checks to confirm successful downloads.
  • Use Case: prepare MovielensLatest_x1 and KuaiVideo_x1 on a local workstation before launching unified training experiments across multiple models.

Quick Start

Download and prepare MovielensLatest_x1 into data/MovielensLatest_x1 using Git LFS or the huggingface_hub API so train/valid/test files are available for model training.

Frequently Asked Questions about dataset-download

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I download CTR datasets for FuxiCTR benchmarking?

You can download CTR datasets like MovielensLatest_x1 or Criteo_x1 using Git LFS, direct zip downloads, or the huggingface_hub API, placing them into a standard data/<dataset_name>/ layout with train, valid, and test files for benchmarking.

What is the standard data layout required for BARS CTR evaluation datasets?

The standard data layout for BARS CTR evaluation requires datasets placed under data/<dataset_name>/ containing train.csv, valid.csv, and test.csv files, structured specifically for FuxiCTR and BARS benchmarking pipelines.

Can I use the huggingface_hub API to fetch KuaiVideo_x1 and TaobaoAd_x1 datasets?

Yes, the huggingface_hub API supports programmatic retrieval of KuaiVideo_x1 and TaobaoAd_x1 datasets, delivering them directly into the standard data/<dataset_name>/ directory layout with train, valid, and test files for local experimentation.

Do I need Git LFS to download MovielensLatest_x1 for CTR model training?

Git LFS is one supported method to download MovielensLatest_x1, but direct zip downloads or the huggingface_hub API serve as alternative retrieval methods to acquire the CTR dataset for model training.

How do I verify CTR dataset integrity after downloading from Hugging Face?

Verify CTR dataset integrity after downloading by performing basic checks including md5 verification, file counts, and quick sanity checks to confirm successful retrieval and proper extraction of train, valid, and test files.