skills.rest
Blackkadder
BlackkadderCOMMUNITY
Explore all skills by this author →
GitHub

databricks-unity-catalog

Query Unity Catalog system tables and perform volume file operations.

Updated Mar 19, 2026
Search Tags:#lineage#databricks#volumes#data profiling#audit logs#unity catalog#system tables
One-click install
npx skills add https://github.com/Blackkadder/databricks-apps-and-agents-workshop --skill databricks-unity-catalog-blackkadder
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-unity-catalog
Source: https://github.com/Blackkadder/databricks-apps-and-agents-workshop/tree/main/.claude/skills/databricks-unity-catalog
Command: npx skills add https://github.com/Blackkadder/databricks-apps-and-agents-workshop --skill databricks-unity-catalog-blackkadder

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Unity Catalog exposes a wide set of operational metadata and file storage primitives that are difficult to explore and query consistently across workspaces. This Skill aggregates guidance, SQL examples, and SDK snippets to help engineers and analysts inspect audit logs, lineage, billing, compute events, query history, and file contents in Volumes without guessing schemas or losing context.

Core Features & Use Cases

  • System table exploration: Ready-to-use SQL queries for audit, table and column lineage, billing usage, compute and query history to support security investigations and governance reporting.
  • Volume file operations: Guidance and SDK examples to list, upload, download, and manage files under the /Volumes/<catalog>/<schema>/<volume>/ path for ML datasets, staging, and archival workflows.
  • Data profiling & monitoring: Instructions for creating data profiling monitors, viewing profile and drift metric tables, and scheduling or refreshing monitors for data quality checks.
  • Integration patterns: Examples showing how to use MCP tools and the databricks-sdk for deterministic operations and automation, plus best practices for permissions and retention.

Quick Start

Retrieve recent audit events for analytics.gold.customers and list files under /Volumes/analytics/raw/my_volume.

Frequently Asked Questions about databricks-unity-catalog

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I query Databricks Unity Catalog audit logs and lineage using system tables?▼

Query Databricks Unity Catalog audit logs and lineage by running SQL queries against system.* schemas to inspect table lineage, column lineage, and audit events for security investigations and governance reporting.

What is the best way to list and download files stored in Databricks Unity Catalog Volumes?▼

The best way to manage files in Databricks Unity Catalog Volumes is using the databricks-sdk to perform deterministic file operations under the /Volumes/<catalog>/<schema>/<volume>/ path for listing, uploading, and downloading datasets.

How do I troubleshoot Databricks compute costs and query performance?▼

Troubleshoot Databricks compute costs and query performance by querying Unity Catalog system tables for billing usage, compute events, and query history to identify expensive workloads and optimize resource allocation.

Can I use the databricks-sdk with MCP tools for Unity Catalog volume operations?▼

Yes, you can use the databricks-sdk with MCP tools for Unity Catalog volume operations, applying integration patterns to automate deterministic file management and metadata queries across workspaces.

How do I set up data profiling and drift monitoring in Unity Catalog?▼

Set up data profiling and drift monitoring in Unity Catalog by creating data profiling monitors, viewing profile metric tables, and scheduling refreshes to execute data quality checks and detect dataset drift.

What metadata is available in Databricks system tables for security audits?▼

Databricks system tables expose operational metadata including audit logs, table and column lineage, billing usage, and compute events, enabling consistent security investigations and governance reporting across workspaces.

Related Skills

Explore More Data & Analytics Skills→
datasciencemonkeydatasciencemonkey
27

databricks-config

Configure and authenticate Databricks profiles for Connect, CLI, and SDK.

Community
Intermediate
mirakuimirakui

databricks-unity-catalog

Query Unity Catalog system tables and volumes for governance and security analysis.

Community
Advanced
leary-pokenleary-poken
1

databricks-genie

Create and manage Databricks Genie Spaces and query them via the Conversation API.

Community
Advanced
databricks-solutionsdatabricks-solutions
1.8k

databricks-python-sdk

Automate Databricks SDK workflows for Python developers.

Official
Intermediate