csv-data-wrangler

What problem does it solve?

This Skill streamlines the often complex and time-consuming process of working with CSV files, from high-performance processing and parsing to meticulous data cleaning.

Core Features & Use Cases

• High-Performance Processing: Handles large CSV files efficiently using tools like Pandas, Polars, and DuckDB.
• Data Cleaning & Validation: Identifies and corrects malformed data, handles encoding issues, and validates data types.
• Transformation & Querying: Reshapes datasets, merges/splits files, and allows SQL-like querying directly on CSVs with DuckDB.
• Use Case: You have a 5GB CSV file with inconsistent formatting and encoding issues. This Skill can efficiently clean, transform, and allow you to query the data using SQL.

Quick Start

Use the csv-data-wrangler skill to process a large CSV file named 'sales_data.csv' by cleaning its data and exporting it as a new CSV file.