data-python

What problem does it solve?

This Skill provides proven Python patterns for data processing using pandas, polars, and pyspark to help you write efficient, scalable data workflows without reinventing the wheel.

Core Features & Use Cases

• Dataframe-centric patterns: vectorized operations, explicit schemas, and chainable transforms across pandas, polars, and pyspark.
• Memory-conscious processing: downcasting dtypes and minimizing allocations for large datasets.
• Use Case: transform a tall data table into a clean analytics-ready dataset with minimal boilerplate.

Quick Start

• Install the required libraries in your Python environment (pandas, polars, pyspark).
• Import the library, load a sample DataFrame, and apply a vectorized transformation such as df["total"] = df["qty"] * df["price"].
• Practice method chaining to build readable, maintainable data pipelines.