skills.rest
leary-poken
leary-pokenCOMMUNITY
Explore all skills by this author →
GitHub

databricks-zerobus-ingest

Ingests data into Delta tables via Zerobus Ingest using gRPC.

1|Updated Mar 17, 2026
Search Tags:#sdk#protobuf#grpc#ingest#databricks#unity-catalog#zerobus
One-click install
npx skills add https://github.com/leary-poken/ai-dev-kit --skill databricks-zerobus-ingest-leary-poken
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-zerobus-ingest
Source: https://github.com/leary-poken/ai-dev-kit/tree/main/databricks-skills/databricks-zerobus-ingest
Command: npx skills add https://github.com/leary-poken/ai-dev-kit --skill databricks-zerobus-ingest-leary-poken

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Zerobus Ingest enables direct, serverless data ingestion into Unity Catalog Delta tables via gRPC, removing the need for a message bus for near-real-time data delivery.

Core Features & Use Cases

  • Direct, serverless ingestion to Delta tables via gRPC
  • Language support across Python, Java, Go, TypeScript, and Rust via the Zerobus Ingest SDK
  • Protobuf schema generation from UC tables and durable, ACK-based ingestion with retry support
  • Use Case: Build production-grade data producers that validate schema and ensure durability while scaling with multiple streams

Quick Start

Initialize a Zerobus stream for your target Delta table and ingest records, then flush to guarantee durability.

Frequently Asked Questions about databricks-zerobus-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest data directly into Databricks Delta tables without a message bus?▼

Direct Delta table ingestion without a message bus uses Zerobus to stream data via gRPC. This serverless approach removes intermediate brokers by sending validated records straight to Unity Catalog tables using cross-language SDKs.

Does Zerobus ingestion work with Python or Java SDKs for Databricks?▼

Zerobus ingestion works with Python, Java, Go, TypeScript, and Rust SDKs. These cross-language SDKs generate Protobuf schemas from Unity Catalog tables and handle durable record ingestion with ACK-based retry support.

How do I ensure data durability when ingesting records into Delta tables?▼

Data durability during Delta table ingestion is ensured by using ACK handling, retries, and explicit flush calls. Producers use the wait_for_offset function to confirm records are committed before considering the ingestion durable.

What Databricks permissions are required for real-time Zerobus ingestion?▼

Real-time Zerobus ingestion requires Unity Catalog managed Delta tables and proper service-principal grants on the target table. These permissions allow the Zerobus SDK to write validated records directly into the specified Delta table.

Can I generate Protobuf schemas automatically from Unity Catalog tables?▼

Generating Protobuf schemas from Unity Catalog tables is supported by the Zerobus Ingest SDK. The SDK reads the UC table structure to create schemas, enabling validated and durable gRPC data streams into Delta tables.

Related Skills

Explore More Software Engineering Skills→
datasciencemonkeydatasciencemonkey
27

databricks-zerobus-ingest

Ingest records into Databricks Delta tables via Zerobus Ingest gRPC.

Community
Advanced
slysikslysik

databricks-lakebase-autoscale

Manage Databricks Lakebase Autoscaling projects, branches, compute, and credentials using the Databricks SDK for Python.

Community
Advanced
juanlamadrid20juanlamadrid20

databricks-zerobus-ingest

Ingest data into Databricks Delta tables via the Zerobus gRPC API.

Community
Advanced
databrickslabsdatabrickslabs
38

databricks-zerobus-ingest

Ingest records directly into Databricks Delta tables via gRPC without a message bus.

Official
Advanced