ingesting-data
CommunityStreamline data import from any source.
Authorancoleman
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill solves the challenge of efficiently and reliably importing data into your systems from diverse sources like cloud storage, APIs, files, and streaming platforms.
Core Features & Use Cases
- Batch Ingestion: Load data from files (CSV, JSON, Parquet) or cloud storage (S3, GCS).
- Streaming Ingestion: Process real-time data from Kafka or Kinesis.
- API Data Feeds: Poll external APIs for updates or receive webhook events.
- Change Data Capture (CDC): Replicate database changes.
- Use Case: Automatically ingest daily sales reports from an S3 bucket, transform them, and load them into a PostgreSQL data warehouse.
Quick Start
Use the ingesting-data skill to load a CSV file named 'sales_data.csv' from the local directory into the 'sales' table in your PostgreSQL database.
Dependency Matrix
Required Modules
dltpolarsboto3confluent-kafkarequestsgoogle-cloud-storageazure-storage-blob
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: ingesting-data Download link: https://github.com/ancoleman/ai-design-components/archive/main.zip#ingesting-data Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.