infer-schema

Derive structured schemas from CSV, JSON, and XML data files.

209|30|Updated Sep 18, 2021
One-click install
npx skills add https://github.com/starlake-ai/starlake --skill infer-schema
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: infer-schema
Source: https://github.com/starlake-ai/starlake/tree/main/.agent/skills/infer-schema
Command: npx skills add https://github.com/starlake-ai/starlake --skill infer-schema

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Data engineers spend significant time guessing and manual-tuning schemas from raw data files. This skill automatically derives structured schemas from common data formats like CSV, JSON, and XML, reducing setup time and mismatch risk.

Core Features & Use Cases

  • Infer schema from CSV, JSON, XML, and other data formats and produce domain YAML
  • Generate domain and table schemas compatible with Starlake pipelines
  • Handle common options such as domain, table, encoding, and optional rowTag for XML data

Quick Start

Run starlake infer-schema with your dataset to generate domain YAML and table schemas.

Frequently Asked Questions about infer-schema

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automatically infer a schema from a CSV or JSON file?

To generate YAML from raw data, provide the file path to the infer-schema tool, which automatically parses CSV, JSON, or XML formats and outputs structured domain and table YAML for pipelines.

Can I parse XML data and use a rowTag during schema inference?

Yes, you can parse XML data during schema inference by utilizing the optional rowTag parameter, which allows the tool to correctly identify and structure records within the XML hierarchy.

How do I handle custom encoding when inferring schemas from delimited files?

You can handle custom encoding when inferring schemas from delimited files by specifying the optional encoding parameter, ensuring the tool accurately reads and parses characters from your source data.

What is the best way to generate Starlake pipeline YAML from raw data?

The best way to generate Starlake pipeline YAML from raw data is using the infer-schema tool, which automatically derives structured schemas from your CSV, JSON, or XML files in one step.

Does infer-schema work with other delimited formats besides CSV and JSON?

Yes, infer-schema works with other delimited formats besides CSV and JSON, allowing you to either force a specific file format or automatically detect the structure to generate compatible YAML schemas.