expanso-kafka-to-s3

Official

Stream Kafka to S3

Authorexpanso-io
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the process of streaming data from Kafka topics directly into an S3 bucket, ensuring data is reliably stored and accessible.

Core Features & Use Cases

  • Real-time Data Ingestion: Continuously streams data from specified Kafka topics.
  • S3 Archiving: Writes data to an S3 bucket with configurable partitioning and batching.
  • Use Case: Monitor real-time events from a Kafka topic and archive them hourly into an S3 bucket for historical analysis and compliance.

Quick Start

Configure your Kafka and AWS credentials and then run the pipeline script.

Dependency Matrix

Required Modules

None required

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: expanso-kafka-to-s3
Download link: https://github.com/expanso-io/expanso-skills/archive/main.zip#expanso-kafka-to-s3

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.