duckdb-transformer

What problem does it solve?

This Skill eliminates the tedious manual work of transforming large datasets with complex SQL operations. It automates high-performance data transformations using DuckDB, saving time and ensuring accuracy in your data pipeline.

Core Features & Use Cases

• SQL Transformations: Apply complex SQL joins, aggregations, and business logic directly to Bronze layer data using DuckDB's in-memory capabilities.
• Bronze to Silver/Gold: Efficiently transform raw Bronze layer data into refined Silver or Gold datasets, ready for analytics and reporting.
• Use Case: Transform raw sales data (Bronze) by joining customer information and aggregating sales figures to create a daily sales report (Silver) for analysis, all within a high-performance environment.

Quick Start

Use the duckdb-transformer skill to load 'Bronze_Cases.csv' and 'Bronze_Company.csv', then join them on 'company_id' and count total cases per company.