databricks-zerobus-ingest

Community

Direct Delta ingestion via Zerobus Ingest.

Authordatasciencemonkey
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Zerobus Ingest enables direct, serverless ingestion of records into Databricks Delta tables via gRPC, removing the need for an external message bus and enabling near-real-time data delivery.

Core Features & Use Cases

  • Protobuf and JSON ingestion across multiple languages via the Zerobus Ingest SDKs (Python, Java, Go, TypeScript, Rust)
  • Protobuf schema generation from Unity Catalog tables and type-safe bindings for generated records
  • Stream-based ingestion with ACK handling, retries, and backoff to ensure durability
  • Pre-create and manage target Delta tables; monitor throughput, and implement schema evolution with re-generation of .proto files

Quick Start

Install the Zerobus Ingest SDK and configure your environment to begin streaming data into your Delta table.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: databricks-zerobus-ingest
Download link: https://github.com/datasciencemonkey/coding-agents-databricks-apps/archive/main.zip#databricks-zerobus-ingest

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.