skills.rest
ScottHMcKean
ScottHMcKeanCOMMUNITY
Explore all skills by this author →
GitHub

databricks-unity-catalog

Query Databricks Unity Catalog system tables and manage volume files.

3|Updated Jan 2, 2025
Search Tags:#governance#lineage#databricks#volumes#audit logs#unity catalog#system tables
One-click install
npx skills add https://github.com/ScottHMcKean/genai_notebooks --skill databricks-unity-catalog-scotthmckean
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-unity-catalog
Source: https://github.com/ScottHMcKean/genai_notebooks/tree/main/.cursor/skills/databricks-unity-catalog
Command: npx skills add https://github.com/ScottHMcKean/genai_notebooks --skill databricks-unity-catalog-scotthmckean

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill simplifies working with Databricks Unity Catalog by providing direct access to system tables for monitoring and governance, and enabling efficient file management within volumes.

Core Features & Use Cases

  • System Table Queries: Analyze audit logs, lineage, billing, compute, jobs, and query history.
  • Volume File Operations: Upload, download, list, and manage files within Unity Catalog volumes (/Volumes/).
  • Use Case: Track who accessed a sensitive table last week by querying audit logs, or upload ML model artifacts to a specific volume path for version control.

Quick Start

Use the databricks unity catalog skill to list all files in the volume path '/Volumes/main/default/my_volume/data/'.

Frequently Asked Questions about databricks-unity-catalog

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I query Databricks Unity Catalog system tables for audit logs and lineage?▼

Query Databricks Unity Catalog system tables for audit logs and lineage by executing SQL queries against the system schema. This allows you to analyze audit logs, lineage, billing, compute, jobs, and query history for detailed monitoring and data governance within the Databricks environment.

How do I upload and manage files in Unity Catalog volumes?▼

Upload, download, list, and manage files in Unity Catalog volumes by using Python SDK or MCP tools to perform file operations on volume paths. This enables efficient data management and version control for assets like ML model artifacts stored within the `/Volumes/` directory.

Can I track who accessed a sensitive table in Databricks using system tables?▼

Track who accessed a sensitive table in Databricks by querying Unity Catalog audit logs through system tables. You can monitor detailed access patterns, such as tracking specific user interactions with sensitive tables over a defined period, using SQL queries.

What do I need to interact with Unity Catalog volumes programmatically?▼

To interact with Unity Catalog volumes programmatically, you need to use the Python SDK or MCP tools for file operations, and SQL queries for system table access. This Skill requires a Databricks environment setup to execute these administrative and governance tasks.

Does this approach support monitoring compute and billing data in Databricks?▼

Yes, querying Databricks Unity Catalog system tables supports monitoring compute and billing data. You can analyze compute usage, billing records, and job execution history directly by running SQL queries against the provided system tables for comprehensive environment oversight.

Related Skills

Explore More Data & Analytics Skills→
alessandro9110alessandro9110
4

databricks-unity-catalog

Query Unity Catalog system tables and manage files in volumes.

Community
Intermediate
nahisahonahisaho
3

scientific-model-monitoring

Detect data and concept drift in production ML models.

Community
Advanced
datasciencemonkeydatasciencemonkey
27

databricks-unity-catalog

Query Unity Catalog system tables and manage volume files in Databricks.

Community
Intermediate
ThomazRossitoThomazRossito
31

databricks-unity-catalog

Query and govern Unity Catalog system tables and volumes.

Community
Intermediate