expanso-kafka-to-s3
OfficialStream Kafka to S3
Authorexpanso-io
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill automates the process of streaming data from Kafka topics directly into an S3 bucket, ensuring data is reliably stored and accessible.
Core Features & Use Cases
- Real-time Data Ingestion: Continuously streams data from specified Kafka topics.
- S3 Archiving: Writes data to an S3 bucket with configurable partitioning and batching.
- Use Case: Monitor real-time events from a Kafka topic and archive them hourly into an S3 bucket for historical analysis and compliance.
Quick Start
Configure your Kafka and AWS credentials and then run the pipeline script.
Dependency Matrix
Required Modules
None requiredComponents
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: expanso-kafka-to-s3 Download link: https://github.com/expanso-io/expanso-skills/archive/main.zip#expanso-kafka-to-s3 Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.