skills.rest
thbeh
thbehCOMMUNITY
Explore all skills by this author →
GitHub

databricks-zerobus-ingest

Automate near real-time data ingestion into Databricks Delta tables with Zerobus.

Updated May 31, 2026
Search Tags:#data ingestion#grpc#databricks#zerobus#delta tables
One-click install
npx skills add https://github.com/thbeh/coding-agents-databricks-apps --skill databricks-zerobus-ingest-thbeh
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-zerobus-ingest
Source: https://github.com/thbeh/coding-agents-databricks-apps/tree/main/.claude/skills/databricks-zerobus-ingest
Command: npx skills add https://github.com/thbeh/coding-agents-databricks-apps --skill databricks-zerobus-ingest-thbeh

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires databricks-sdk, databricks-zerobus-ingest-sdk, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a solution for near real-time data ingestion into Databricks Delta tables, eliminating the need for a message bus infrastructure and offering durability guarantees for each ingested record.

Core Features & Use Cases

  • Near Real-Time Data Ingestion: Directly write data into Delta tables at a record-by-record level.
  • Durability and Acknowledgment: Ensures all records up to an offset have been durably written to the target table.
  • Multiple Language Support: Offers SDKs for Python, Java, Go, TypeScript/Node.js, and Rust for flexibility.
  • Protobuf Schema Generation: Automates the creation of .proto files from Unity Catalog table definitions for type safety and performance.

Quick Start

Use the databricks-zerobus-ingest skill to set up and configure your data ingestion process with the necessary service principal and target table details.

Frequently Asked Questions about databricks-zerobus-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest data into Databricks Delta tables in near real-time?▼

This Skill automates near real-time data ingestion into Databricks Delta tables via the Zerobus gRPC API, writing records directly at the row level with durability guarantees and acknowledgments for each ingested record.

What is the best way to write streaming data to Databricks without a message bus?▼

The best way to write streaming data to Databricks without a message bus is using Zerobus, which provides direct, durable data ingestion into Delta tables and ensures all records up to a specific offset are durably written.

Does databricks-zerobus-ingest support schema validation for Protobuf?▼

Yes, databricks-zerobus-ingest supports schema validation by automating the creation of .proto files from Unity Catalog table definitions, ensuring type safety and efficient serialization for your data ingestion workflows.

Can I use Python or Java SDKs to ingest data into Databricks Delta tables?▼

Yes, you can use SDKs for Python, Java, Go, TypeScript/Node.js, and Rust to configure and manage your data ingestion process into Databricks Delta tables, offering flexibility for various programming environments.

How do I set up Zerobus data ingestion for Databricks Delta tables?▼

To set up Zerobus data ingestion for Databricks Delta tables, configure the process with your necessary service principal and target table details, enabling near real-time, record-by-record writes directly to your Delta tables.

Related Skills

Explore More Data & Analytics Skills→
datasciencemonkeydatasciencemonkey
27

databricks-zerobus-ingest

Ingest records into Databricks Delta tables via Zerobus Ingest gRPC.

Community
Advanced
NimblewayNimbleway
17

nimble-search

Automates live web search, data extraction, and dashboard creation in Databricks.

Official
Advanced
Zack2626-okZack2626-ok

databricks-zerobus-ingest

Ingest data into Databricks Delta tables via the Zerobus gRPC API.

Community
Advanced
databrickslabsdatabrickslabs
38

databricks-zerobus-ingest

Ingest records directly into Databricks Delta tables via gRPC without a message bus.

Official
Advanced