skills.rest
starlake-ai
starlake-aiOFFICIAL
Explore all skills by this author →
GitHub

extract-data

Extract database table data into CSV and Parquet files.

209|30|Updated Sep 18, 2021
Search Tags:#database#etl#csv#parquet#incremental#extract
One-click install
npx skills add https://github.com/starlake-ai/starlake --skill extract-data
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: extract-data
Source: https://github.com/starlake-ai/starlake/tree/main/.agent/skills/extract-data
Command: npx skills add https://github.com/starlake-ai/starlake --skill extract-data

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Extract data from database tables defined in your mapping configuration and write it to portable formats like CSV or Parquet, reducing manual scripting.

Core Features & Use Cases

  • Automated extraction from configured table mappings to CSV and Parquet files.
  • Support for incremental extractions and filtering with include/exclude tables or schemas.
  • Configurable output options and limits to fit scalable data pipelines.

Quick Start

Run starlake extract-data with --config <path> --outputDir <path> to export database data to CSV or Parquet files.

Frequently Asked Questions about extract-data

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate database extraction to CSV or Parquet files?▼

Automate database extraction by running a configured extraction command that reads table mappings and exports data directly to CSV or Parquet files. You need a valid config file and an output directory to generate the portable data files.

Can I perform incremental data exports from specific database schemas?▼

Yes, incremental data exports are supported for specific database schemas. You can filter the extraction by including or excluding specific tables or schemas, allowing you to pull only the updated records into your CSV or Parquet output.

What is the best way to export database tables for data engineering pipelines?▼

The best way to export database tables for pipelines is using an automated extraction tool with configurable output options and limits. This approach writes database records to portable formats like CSV or Parquet, reducing manual scripting for data engineering workflows.

How do I configure periodic data snapshots from a database?▼

Configure periodic data snapshots by defining your target table mappings in a configuration file and specifying an output directory. The extraction process reads this config to automate periodic snapshots of your database data into CSV or Parquet files.

Do I need a specific config file format to extract database data?▼

Yes, you need a valid config file to extract database data successfully. The config file defines the table mappings, schema filters, and output preferences required to write the extracted database records to the specified CSV or Parquet files.

Related Skills

Explore More Data & Analytics Skills→
Snowflake-LabsSnowflake-Labs
1

oracle-connection

Configure and verify Oracle database connections for schema extraction.

Official
Intermediate
starlake-aistarlake-ai
209

parquet2csv

Convert Parquet files into CSV format for batch ETL pipelines.

Official
Intermediate
CatsofsufferingCatsofsuffering
5

data-engineering

Manage and validate data pipelines and streaming workflows across orchestration and quality tools.

Community
Advanced
AradotsoAradotso
5

harvard-artifacts-data-engineering-pipeline

Extract artifact data from the Harvard Art Museums API into SQL databases.

Official
Advanced