earth2studio-create-datasource

Create and validate Earth2Studio data source wrappers connecting remote stores to async fetching infrastructure.

3.2k|370|Updated Feb 25, 2026
One-click install
npx skills add https://github.com/NVIDIA/skills --skill earth2studio-create-datasource
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: earth2studio-create-datasource
Source: https://github.com/NVIDIA/skills/tree/main/skills/earth2studio-create-datasource
Command: npx skills add https://github.com/NVIDIA/skills --skill earth2studio-create-datasource

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Building a new data source integration for Earth2Studio requires navigating lexicons, async fetching patterns, registration, documentation, testing, and PR submission — a long, error-prone workflow. This Skill guides an agent through the entire process end-to-end with canonical patterns and confirmation gates.

Core Features & Use Cases

  • Guided 15-Step Workflow: From analyzing a remote store (S3, GCS, Azure, HTTP, HuggingFace) through lexicon creation, async implementation, registration, docs, CHANGELOG, tests, validation plots, and PR submission with Greptile review triage.
  • Four Source Types: Supports DataSource, ForecastSource, DataFrameSource, and ForecastFrameSource with skeleton templates and canonical test structures.
  • Use Case: Ask your agent to "add a data source for NOAA GFS analysis on S3" and it produces the source class, lexicon, test suite, documentation updates, and an opened PR with a sanity-check validation comment.

Quick Start

Ask your agent to add a new Earth2Studio data source for a specific remote data store, providing its URL or API documentation.

Frequently Asked Questions about earth2studio-create-datasource

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add a new data source to Earth2Studio?

Follow the guided workflow: analyze the remote store, choose the source type (DataSource, ForecastSource, DataFrameSource, or ForecastFrameSource), create a lexicon mapping variables, implement the async source class, register it, and add tests. The skill provides skeleton templates for each step.

What is the difference between DataSource and ForecastSource in Earth2Studio?

DataSource returns an xr.DataArray for gridded analysis or reanalysis data without lead_time, while ForecastSource includes a lead_time dimension for gridded forecast data. Sparse observation sources use DataFrameSource or ForecastFrameSource returning pd.DataFrame instead.

Which Python libraries should I use to access S3 or GCS data stores?

Prefer fsspec-based filesystems: s3fs for AWS S3, gcsfs for Google Cloud Storage, adlfs for Azure, and fsspec's HTTPFileSystem for HTTP. Avoid boto3, google-cloud-storage, or raw requests unless fsspec cannot access the store.

What tests are required for a new Earth2Studio data source?

Required tests include a slow network fetch test, a cache toggle test, a mandatory mock test with no network access, exception handling tests, and an available() classmethod test. Target at least 90% line coverage when running with the --slow flag.

When should I not use this data source creation skill?

Do not use it for fetching data with existing sources, running model inference, or installation tasks. It handles one source type per invocation and requires network access for the real-data validation step.