zerobus-ingest
CommunityStream data directly to Databricks Delta.
AuthorPaldom
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill enables the creation of data producers that write records directly into Databricks Delta tables via gRPC, eliminating the need for intermediate message bus infrastructure like Kafka or Kinesis.
Core Features & Use Cases
- Direct Ingestion: Write data record-by-record directly into Unity Catalog Delta tables.
- Multi-Language Support: Build producers using Python, Java, Go, TypeScript, or Rust.
- Protobuf & JSON: Supports both type-safe Protobuf serialization for production and JSON for rapid prototyping.
- Schema Generation: Automatically generate Protobuf schemas from Unity Catalog table definitions.
- Production Hardening: Includes patterns for ACK handling, retries, reconnection, and throughput management.
- Use Case: A real-time IoT sensor application needs to ingest millions of readings per minute into a Databricks Delta table for immediate analysis. This Skill provides the tools to build a high-throughput producer using the Zerobus SDK.
Quick Start
Use the zerobus-ingest skill to generate a Python script for ingesting JSON records into your specified Databricks table.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: zerobus-ingest Download link: https://github.com/Paldom/databricks-apps-streamlit-vibe-coding-starter/archive/main.zip#zerobus-ingest Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.