public-dataset-exploration

Search Kaggle, Hugging Face, and GitHub for raw public datasets.

57|6|Updated Jan 16, 2026
One-click install
npx skills add https://github.com/lightning-rod-labs/lightningrod-python-sdk --skill public-dataset-exploration
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: public-dataset-exploration
Source: https://github.com/lightning-rod-labs/lightningrod-python-sdk/tree/main/skills/public-dataset-exploration
Command: npx skills add https://github.com/lightning-rod-labs/lightningrod-python-sdk --skill public-dataset-exploration

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you locate and shortlist raw public datasets in a new domain when you don’t yet have training-ready data available.

Core Features & Use Cases

  • Market discovery across platforms: Search Kaggle, Hugging Face, and GitHub for domain-relevant raw or semi-structured datasets suitable for conversion.
  • Training-readiness filtering: Identify “relevant but not training-ready” sources by checking whether the data can produce forecasting questions or document-style Q&A rather than already being instruction-tuned or synthetic.
  • Seed creation workflow planning: Convert downloaded files into samples using the SDK’s conversion utilities and assemble an input dataset for downstream pipelines.

Use case: You’re starting a sports forecasting project and have a domain focus, but no documents or labels—this Skill guides you to find a usable raw dataset (e.g., event logs or match stats), convert it into samples, and package it as seeds for further labeling and training.

Quick Start

Ask the Skill to explore public datasets for your domain and recommend 1–3 candidates that are relevant but not already training-ready.

Frequently Asked Questions about public-dataset-exploration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find raw public datasets on Kaggle or Hugging Face for forecasting?

To find raw public datasets for forecasting, you can use this Skill to search Kaggle, Hugging Face, and GitHub for domain-relevant data. It shortlists candidates that are not already instruction-tuned, ensuring the raw data is suitable for conversion into training seeds.

What is the best way to convert raw data files into training seeds?

The best way to convert raw data files into training seeds is by using the SDK's conversion utilities. This Skill helps you download small subsets from discovered datasets and assemble them into an input dataset for your downstream labeling and training pipelines.

Can I use GitHub repositories for document-based training data discovery?

Yes, you can use GitHub repositories for document-based training data discovery. This Skill explores GitHub alongside Kaggle and Hugging Face to find raw or semi-structured datasets that can be converted into samples for document-based training.

Does this dataset discovery process check for instruction-tuned data?

Yes, the dataset discovery process checks for instruction-tuned data. It actively filters out instruction/Q&A formatted or synthetic datasets, prioritizing raw sources that can produce forecasting questions or document-style Q&A for your training readiness.

How do I select public datasets that are suitable for seed generation?

You can select public datasets suitable for seed generation by having this Skill evaluate candidates based on relevance and reasonable licensing. It maps shortlisted datasets into a conversion-to-seeds workflow, ensuring they are raw and not already training-ready.