parquet2csv

Convert Parquet files into CSV format for batch ETL pipelines.

209|30|Updated Sep 18, 2021
One-click install
npx skills add https://github.com/starlake-ai/starlake --skill parquet2csv
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: parquet2csv
Source: https://github.com/starlake-ai/starlake/tree/main/.agent/skills/parquet2csv
Command: npx skills add https://github.com/starlake-ai/starlake --skill parquet2csv

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Parquet data is efficient for storage, but many downstream tools and analysts require CSV format; this skill automates conversion to CSV to enable easy data consumption.

Core Features & Use Cases

  • Parquet to CSV Conversion: Transform Parquet files into CSV for interoperability with non-Parquet tools.
  • Batch Processing: Convert multiple Parquet files in a single run by pointing input_dir to a folder.
  • Output Customization: Control output location, domain, schema, and write mode to fit into ETL pipelines.

Quick Start

Execute starlake parquet2csv with --input_dir and --output_dir to generate CSV outputs from Parquet files.

Frequently Asked Questions about parquet2csv

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert Parquet files to CSV for downstream analytics?

To convert Parquet files to CSV, point the conversion tool's input_dir to your Parquet dataset and specify an output_dir to generate CSV files for downstream analytics and data sharing.

Can I batch convert multiple Parquet files to CSV at once?

Yes, you can batch convert multiple Parquet files to CSV by configuring the input_dir parameter to point to a folder containing the Parquet datasets for a single processing run.

What is the best way to export Parquet data to CSV in an ETL pipeline?

The best way to export Parquet data to CSV in an ETL pipeline is to configure parameters like domain, schema, write_mode, and partitions to seamlessly fit the conversion into your batch data processing workflow.

Does Spark work well for converting Parquet datasets to CSV format?

Yes, Spark works well for converting Parquet datasets to CSV format, as the conversion process supports Spark-based batch ETL pipelines requiring structured CSV exports from efficient Parquet storage.

What parameters can I customize when transforming Parquet files into CSV?

When transforming Parquet files into CSV, you can customize input_dir, output_dir, domain, schema, delete_source, write_mode, partitions, and additional options to configure the conversion process.

Why convert Parquet storage to CSV format for data interoperability?

You convert Parquet storage to CSV format to enable data interoperability across non-Parquet tools, allowing downstream analysts to easily consume the data without needing specialized Parquet readers.