skills.rest
LigphiDonk
LigphiDonkCOMMUNITY
Explore all skills by this author →
GitHub

dataset-discovery

Search HuggingFace Hub, OpenML, GitHub, and Semantic Scholar for relevant ML datasets.

708|51|Updated Mar 10, 2026
Search Tags:#multi-source#deduplication#ranking#data-sourcing#dataset-discovery#ml-datasets#dataset-search
One-click install
npx skills add https://github.com/LigphiDonk/Oh-my--paper --skill dataset-discovery-ligphidonk
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: dataset-discovery
Source: https://github.com/LigphiDonk/Oh-my--paper/tree/main/src-tauri/resources/skills/dataset-discovery
Command: npx skills add https://github.com/LigphiDonk/Oh-my--paper --skill dataset-discovery-ligphidonk

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, and includes scripts (resource) components.

What problem does it solve?

Locating relevant ML datasets across multiple sources is time-consuming and error-prone; this Skill automates cross-source discovery to surface important datasets for a given research task.

Core Features & Use Cases

  • Multi-source search: queries HuggingFace Hub, OpenML, GitHub, and Semantic Scholar to find datasets aligned with a task.
  • Ranking and deduplication: returns a deduplicated, relevance-scored list to help pick candidate datasets.
  • Detail and preview: generates metadata and README summaries; can pull sample rows or view dataset config details in a project workspace.
  • Use Case: a data scientist exploring NLP classification uses this Skill to assemble a ranked list of text datasets with licenses and sizes.

Quick Start

Run a dataset search with your query and review the ranked results.

Frequently Asked Questions about dataset-discovery

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I search for ML datasets across multiple sources like HuggingFace and OpenML?▼

To search for ML datasets across multiple sources, use this Skill to query HuggingFace Hub, OpenML, GitHub, and Semantic Scholar simultaneously. It returns a ranked, deduplicated list with relevant metadata for your research task.

Can I filter dataset search results by modality and license?▼

Yes, you can filter dataset search results by modality and license. The Skill supports configurable limits, modality filters, and license considerations to help you find relevant datasets.

What is the best way to deduplicate dataset search results from GitHub and Semantic Scholar?▼

The best way to deduplicate dataset search results is to use this Skill, which automatically scores relevance and removes duplicate entries from sources like GitHub and Semantic Scholar. It outputs a clean, ranked list.

How do I get dataset metadata and sample rows for review in my workspace?▼

To get dataset metadata and sample rows, run this Skill to generate README summaries and pull sample data. Results and metadata are stored directly in your project workspace for easy review.

Do I need to install requests to search for ML datasets?▼

Yes, you need to install the requests library to search for ML datasets. This Skill uses requests as its primary dependency to query multiple dataset sources and retrieve search results.

Related Skills

Explore More Data & Analytics Skills→
patricio0312revpatricio0312rev
5

vector-db-setup

Configure Pinecone, Chroma, pgvector, and Qdrant vector databases for semantic search.

Community
Advanced
MigoXLabMigoXLab
736

dingo-data-quality

Evaluate machine learning datasets with rule-based and LLM-based checks.

Official
Advanced
swarm-ai-researchswarm-ai-research

Programmatic EDA

Profile local CSV, Parquet, and Excel datasets with pandas and numpy, outputting Markdown reports.

Official
Intermediate
MCERQUAMCERQUA
1

browser-data-processor

Convert raw website scrape data into structured JSON records.

Community
Advanced