skills.rest
dsa110
dsa110OFFICIAL
Explore all skills by this author →
WebsiteGitHub

data-io-management

Manage ingestion, staging, metadata, storage layout, and HDF5 lifecycle for astronomical datasets.

Updated Aug 23, 2026
Search Tags:#data management#metadata#pipeline#ingestion#storage#hdf5
One-click install
npx skills add https://github.com/dsa110/dsa110-contimg --skill data-io-management
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-io-management
Source: https://github.com/dsa110/dsa110-contimg/tree/main/docs/skills/data-io-management
Command: npx skills add https://github.com/dsa110/dsa110-contimg --skill data-io-management

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill streamlines the complex processes of ingesting, staging, and managing data throughout its lifecycle, ensuring metadata and storage integrity.

Core Features & Use Cases

  • Data Ingestion: Handles the intake of new datasets into the system.
  • Metadata Management: Ensures that all data has accurate and complete metadata.
  • Storage Layout: Manages the organization and structure of data within storage systems.
  • HDF5 Lifecycle: Oversees the creation, modification, and archival of HDF5 files.
  • Product I/O: Manages the input and output of processed data products.
  • Use Case: When new observational data arrives, this Skill can ingest it, validate its metadata against expected schemas, organize it into the defined storage layout, and prepare it for subsequent processing steps.

Quick Start

Use the data-io-management skill to inspect the current metadata for dataset ID '12345'.

Frequently Asked Questions about data-io-management

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I manage the HDF5 lifecycle for astronomical datasets?▼

Managing the HDF5 lifecycle involves overseeing the creation, modification, and archival of HDF5 files. This Skill handles these stages by applying documented scripts and validation checkpoints to ensure safe operations and data integrity.

What is the best way to validate metadata during data ingestion?▼

Validating metadata during data ingestion requires checking new datasets against expected schemas. This Skill streamlines this process by validating metadata accuracy and completeness before organizing data into the defined storage layout.

How do I inspect metadata for a specific dataset ID?▼

Inspecting metadata for a specific dataset ID involves querying the system to retrieve current metadata attributes. This Skill enables you to inspect and verify metadata accuracy using documented procedures and validation checkpoints.

Can I use this Skill to organize storage layout for new observational data?▼

Organizing storage layout for new observational data is a core feature. This Skill manages the structure of data within storage systems by ingesting new datasets, validating schemas, and preparing them for subsequent processing steps.

Does data-io-management handle product I/O for processed data products?▼

Handling product I/O for processed data products is a supported feature. This Skill manages both the input and output operations of processed data, ensuring safe operations through documented scripts and validation checkpoints.

Related Skills

Explore More Data & Analytics Skills→
nrakownrakow
1

ingestion-strategy

Select and configure data ingestion strategies for Fivetran, Airbyte, or custom pipelines.

Community
Intermediate
felixboehmfelixboehm

exploratory-data-analysis

Analyze scientific data files across 200+ formats and generate markdown reports.

Community
Advanced
EurecaMomentEurecaMoment

benchclaw-stage3-real-image-cleaning

Automate cleaning of real-image datasets for BenchClaw benchmarking with Data-Juicer.

Official
Intermediate
AgentientAgentient
2

corpus-lifecycle

Automate Vertex AI RAG corpus creation, updates, and deletion.

Official
Intermediate