parquet2csv

Convert Parquet files into CSV format for batch ETL pipelines.

209|30|Updated Sep 18, 2021
One-click install
npx skills add https://github.com/starlake-ai/starlake --skill parquet2csv
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: parquet2csv
Source: https://github.com/starlake-ai/starlake/tree/main/.agent/skills/parquet2csv
Command: npx skills add https://github.com/starlake-ai/starlake --skill parquet2csv

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Parquet data is efficient for storage, but many downstream tools and analysts require CSV format; this skill automates conversion to CSV to enable easy data consumption.

Core Features & Use Cases

  • Parquet to CSV Conversion: Transform Parquet files into CSV for interoperability with non-Parquet tools.
  • Batch Processing: Convert multiple Parquet files in a single run by pointing input_dir to a folder.
  • Output Customization: Control output location, domain, schema, and write mode to fit into ETL pipelines.

Quick Start

Execute starlake parquet2csv with --input_dir and --output_dir to generate CSV outputs from Parquet files.

Frequently Asked Questions about parquet2csv

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert Parquet files to CSV for downstream analytics?▼

To convert Parquet files to CSV, point the conversion tool's input_dir to your Parquet dataset and specify an output_dir to generate CSV files for downstream analytics and data sharing.

Can I batch convert multiple Parquet files to CSV at once?▼

Yes, you can batch convert multiple Parquet files to CSV by configuring the input_dir parameter to point to a folder containing the Parquet datasets for a single processing run.

What is the best way to export Parquet data to CSV in an ETL pipeline?▼

The best way to export Parquet data to CSV in an ETL pipeline is to configure parameters like domain, schema, write_mode, and partitions to seamlessly fit the conversion into your batch data processing workflow.

Does Spark work well for converting Parquet datasets to CSV format?▼

Yes, Spark works well for converting Parquet datasets to CSV format, as the conversion process supports Spark-based batch ETL pipelines requiring structured CSV exports from efficient Parquet storage.

What parameters can I customize when transforming Parquet files into CSV?▼

When transforming Parquet files into CSV, you can customize input_dir, output_dir, domain, schema, delete_source, write_mode, partitions, and additional options to configure the conversion process.

Why convert Parquet storage to CSV format for data interoperability?▼

You convert Parquet storage to CSV format to enable data interoperability across non-Parquet tools, allowing downstream analysts to easily consume the data without needing specialized Parquet readers.