databricks-zerobus-ingest

Ingest records into Unity Catalog Delta tables via Zerobus Ingest using gRPC.

1|1|Updated Oct 1, 2025
One-click install
npx skills add https://github.com/mkgs-databricks-demos/synthea-on-fhir --skill databricks-zerobus-ingest-mkgs-databricks-demos
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-zerobus-ingest
Source: https://github.com/mkgs-databricks-demos/synthea-on-fhir/tree/main/.cursor/skills/databricks-zerobus-ingest
Command: npx skills add https://github.com/mkgs-databricks-demos/synthea-on-fhir --skill databricks-zerobus-ingest-mkgs-databricks-demos

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Direct, durable record-by-record ingestion into Delta tables via Zerobus Ingest using gRPC.

Core Features & Use Cases

  • Direct, durable ingestion into Unity Catalog managed Delta tables using language SDKs (Python, Java, Go, TypeScript, Rust)
  • Support for JSON and Protobuf serialization with ACK handling and retry/reconnect patterns
  • Protobuf schema generation from UC tables and end-to-end ingestion patterns

Quick Start

Create a minimal Zerobus stream and ingest a sample record to verify end-to-end ingestion to a Unity Catalog Delta table.

Frequently Asked Questions about databricks-zerobus-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest records directly into Delta tables using gRPC?▼

Direct, durable record-by-record ingestion into Delta tables via Zerobus Ingest using gRPC with multi-language SDKs, supporting Protobuf and JSON serialization with ACK handling and retries.

What do I need to set up before ingesting data into Unity Catalog managed Delta tables?▼

Ingesting into Unity Catalog managed Delta tables requires a pre-created managed Delta table, a service principal with proper grants, and the configured Zerobus server endpoint.

Can I use Python or Java SDKs for Protobuf ingestion into Databricks?▼

Yes, Zerobus Ingest supports multi-language SDKs including Python, Java, Go, TypeScript, and Rust for Protobuf and JSON ingestion into Databricks Delta tables.

How does Zerobus handle schema generation for Delta table ingestion?▼

Zerobus generates Protobuf schemas directly from Unity Catalog tables, enabling end-to-end ingestion patterns with structured serialization and reliable ACK handling.

Does Zerobus Ingest support retry and reconnect patterns for durable Delta ingestion?▼

Yes, Zerobus Ingest supports durable record-by-record ingestion with built-in ACK handling and retry/reconnect patterns to ensure data reliability across network interruptions.