Skills
.Work. You
Rest

kafkaload

Official

Efficient Kafka to file data transfer.

Data & Analytics#streaming#json#kafka#parquet#load#offload#data-transfer
Authorstarlake-ai
Version1.0.0
Installs0

System Documentation

What problem does it solve?

The Kafka Load Skill solves the challenge of moving data between Apache Kafka and file-based storage, enabling seamless ingestion, offloading, and archival workflows.

Core Features & Use Cases

  • Ingest: Load data from file storage into Kafka topics with configurable formats (parquet, json, csv).
  • Offload: Persist data from Kafka topics to Parquet/CSV/JSON in the file system for downstream processing.
  • Use Case: You have streaming data in Kafka that needs to be persisted to your data lake for batch processing and analytics.

Quick Start

Run starlake kafkaload with your configuration to transfer data between Kafka topics and file storage.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: kafkaload
Download link: https://github.com/starlake-ai/starlake/archive/main.zip#kafkaload

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.