databricks-zerobus-ingest

You can ingest records into a Unity Catalog Delta table by using the Zerobus Ingest gRPC API to establish a direct streaming connection. This removes the need for external message buses by enabling near real-time data loading with backend durability acknowledgments.

Prerequisites for Delta Lake ingestion with Zerobus include a Unity Catalog managed Delta table, a service principal with MODIFY and SELECT grants, a configured Zerobus server endpoint, and the Zerobus Ingest SDK installed in your environment.

Yes, Zerobus gRPC ingestion supports production data pipelines across Python, Java, Go, TypeScript, and Rust. The SDK provides multi-language support for both JSON and Protobuf data flows.

Protobuf schemas are generated directly from Unity Catalog Delta tables to enable end-to-end streaming. This allows strongly typed records to be sent over gRPC with built-in ACK handling for reliable delivery.

Yes, Zerobus Ingest includes production-grade retry, reconnection, and backoff patterns for resilient data loading. These mechanisms ensure reliable gRPC streaming into Delta tables even during transient network failures.

Using Zerobus gRPC provides a direct, serverless path to write records into Unity Catalog Delta tables. This eliminates external message bus dependencies while providing near real-time loading and durability acknowledgments from the backend.