databricks-zerobus-ingest

Name: databricks-zerobus-ingest
Availability: InStock
Author: laurentprat-db

Builds ZeroBus Ingest clients for gRPC-based data delivery to Databricks Delta tables.

Updated Feb 27, 2026

Search Tags:#real-time #protobuf #grpc #ingest #databricks #delta lake #zerobus

Ready to run

npx skills add https://github.com/LaurentPRAT-DB/LPT_claude_config --skill databricks-zerobus-ingest-laurentprat-db

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: databricks-zerobus-ingest
Source: https://github.com/LaurentPRAT-DB/LPT_claude_config/tree/main/skills/databricks-zerobus-ingest
Command: npx skills add https://github.com/LaurentPRAT-DB/LPT_claude_config --skill databricks-zerobus-ingest-laurentprat-db

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires databricks-sdk, databricks-zerobus-ingest-sdk, grpcio-tools, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill enables direct, record-by-record data ingestion into Databricks Delta tables via gRPC, eliminating the need for intermediate message bus infrastructure.

Core Features & Use Cases

Direct Ingestion: Write data directly to Unity Catalog Delta tables without Kafka or Kinesis.
SDK Support: Build producers using SDKs in Python, Java, Go, TypeScript, and Rust.
Use Case: Ingest real-time sensor data from IoT devices directly into a Databricks Delta table for immediate analysis and dashboarding.

Quick Start

Use the databricks-zerobus-ingest skill to ingest JSON data into your target Databricks table.

Frequently Asked Questions about databricks-zerobus-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I ingest real-time data directly into Databricks Delta tables without Kafka?▼

You can ingest real-time data directly into Databricks Delta tables without Kafka by using gRPC clients to write records bypassing intermediate message bus infrastructure. This enables near real-time, record-by-record ingestion straight to Unity Catalog.

Can I generate ingestion schemas directly from Unity Catalog tables?▼

Yes, you can generate schemas directly from Unity Catalog tables. The ingestion clients use this feature to ensure data streaming into Delta tables matches the existing structure without manual schema definition.

Does the Databricks gRPC ingestion approach support Python and Java SDKs?▼

Yes, the gRPC ingestion approach supports building producers with SDKs in Python, Java, Go, TypeScript, and Rust. This allows you to stream data to Delta tables using your preferred programming language.

What is the best way to handle stream-based ingestion retries for Databricks Delta tables?▼

The best way to handle stream-based ingestion retries is using the built-in ACK handling and retry logic. This ensures reliable record-by-record data delivery to Delta tables even during transient network failures.

How does direct gRPC ingestion compare to using an intermediate message bus for Databricks?▼

Direct gRPC ingestion eliminates the need for intermediate message bus infrastructure, allowing record-by-record data to stream straight into Delta tables. This reduces architectural complexity and latency compared to using message buses.