databricks-zerobus-ingest

Ingest records into Unity Catalog Delta tables via Zerobus Ingest using gRPC.

1|1|Updated Oct 1, 2025
One-click install
npx skills add https://github.com/mkgs-databricks-demos/synthea-on-fhir --skill databricks-zerobus-ingest-mkgs-databricks-demos
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-zerobus-ingest
Source: https://github.com/mkgs-databricks-demos/synthea-on-fhir/tree/main/.cursor/skills/databricks-zerobus-ingest
Command: npx skills add https://github.com/mkgs-databricks-demos/synthea-on-fhir --skill databricks-zerobus-ingest-mkgs-databricks-demos

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Direct, durable record-by-record ingestion into Delta tables via Zerobus Ingest using gRPC.

Core Features & Use Cases

  • Direct, durable ingestion into Unity Catalog managed Delta tables using language SDKs (Python, Java, Go, TypeScript, Rust)
  • Support for JSON and Protobuf serialization with ACK handling and retry/reconnect patterns
  • Protobuf schema generation from UC tables and end-to-end ingestion patterns

Quick Start

Create a minimal Zerobus stream and ingest a sample record to verify end-to-end ingestion to a Unity Catalog Delta table.

Frequently Asked Questions about databricks-zerobus-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest records directly into Delta tables using gRPC?

Direct, durable record-by-record ingestion into Delta tables via Zerobus Ingest using gRPC with multi-language SDKs, supporting Protobuf and JSON serialization with ACK handling and retries.

What do I need to set up before ingesting data into Unity Catalog managed Delta tables?

Ingesting into Unity Catalog managed Delta tables requires a pre-created managed Delta table, a service principal with proper grants, and the configured Zerobus server endpoint.

Can I use Python or Java SDKs for Protobuf ingestion into Databricks?

Yes, Zerobus Ingest supports multi-language SDKs including Python, Java, Go, TypeScript, and Rust for Protobuf and JSON ingestion into Databricks Delta tables.

How does Zerobus handle schema generation for Delta table ingestion?

Zerobus generates Protobuf schemas directly from Unity Catalog tables, enabling end-to-end ingestion patterns with structured serialization and reliable ACK handling.

Does Zerobus Ingest support retry and reconnect patterns for durable Delta ingestion?

Yes, Zerobus Ingest supports durable record-by-record ingestion with built-in ACK handling and retry/reconnect patterns to ensure data reliability across network interruptions.