databricks-model-serving

Deploy and query MLflow models and AI agents on Databricks Model Serving endpoints.

Updated Mar 23, 2024
One-click install
npx skills add https://github.com/m19c/dotfiles --skill databricks-model-serving-m19c
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-model-serving
Source: https://github.com/m19c/dotfiles/tree/main/claude/.claude/skills/databricks-model-serving
Command: npx skills add https://github.com/m19c/dotfiles --skill databricks-model-serving-m19c

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires mlflow, databricks-sdk, langchain, langgraph, databricks-agents, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill provides the infrastructure and tools to deploy MLflow models and AI agents to scalable REST API endpoints on Databricks, enabling efficient and secure access to machine learning models for production use.

Core Features & Use Cases

  • Model Deployment: Deploy MLflow models, custom Python models, and GenAI agents to endpoints.
  • Endpoint Management: Monitor, manage, and update deployed endpoints.
  • Querying: Send requests to deployed endpoints and retrieve predictions or responses.
  • Use Case: Deploy a machine learning model to predict customer churn and query the endpoint from a Python script or a web application.

Quick Start

Deploy a GenAI agent using the databricks-model-serving skill:

databricks run-python -f deploy_agent.py --python-version 3.8

Deploy a classical ML model using the databricks-model-serving skill:

databricks run-python -f deploy_model.py --python-version 3.8

Frequently Asked Questions about databricks-model-serving

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy MLflow models to Databricks Model Serving endpoints?

Deploy MLflow models to Databricks Model Serving endpoints by running Python scripts that use the Databricks SDK to provision scalable REST APIs, enabling secure production access to your machine learning predictions.

Can I deploy LangChain AI agents to Databricks endpoints?

Yes, you can deploy LangChain AI agents to Databricks endpoints. The skill handles deployment for GenAI agents built with langgraph and langchain, creating queryable REST API endpoints for your applications.

Do I need Unity Catalog to use Databricks Model Serving?

Yes, Unity Catalog is required to use Databricks Model Serving. You must have Unity Catalog and Databricks Model Serving features enabled in your environment to manage deployments and endpoint security.

What's the best way to query a deployed ML model on Databricks?

The best way to query a deployed ML model on Databricks is by sending requests through the Databricks SDK to your active Model Serving endpoint, retrieving predictions or responses directly in your Python scripts.

How do I manage and update deployed endpoints in Databricks?

Manage and update deployed endpoints in Databricks using the Databricks SDK to monitor status, modify configurations, and apply updates to your MLflow models and AI agents serving traffic.

Does this skill support deploying custom Python models?

Yes, this skill supports deploying custom Python models. You can deploy MLflow models, custom Python models, and GenAI agents to scalable endpoints using the provided deployment scripts.