skills.rest
mkgs-databricks-demos
mkgs-databricks-demosOFFICIAL
Explore all skills by this author →
GitHub

databricks-serverless-migration

Migrate Databricks workloads from classic to serverless compute with compatibility analysis.

Updated Jul 4, 2026
Search Tags:#serverless#migration#workload#compute#databricks
One-click install
npx skills add https://github.com/mkgs-databricks-demos/aiSkillUpdater --skill databricks-serverless-migration
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-serverless-migration
Source: https://github.com/mkgs-databricks-demos/aiSkillUpdater/tree/main/databricks-serverless-migration
Command: npx skills add https://github.com/mkgs-databricks-demos/aiSkillUpdater --skill databricks-serverless-migration

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires databricks-cli, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill helps users migrate their Databricks workloads from classic compute to serverless compute, simplifying the process and ensuring compatibility.

Core Features & Use Cases

  • Compatibility Analysis: Analyze existing Databricks code for serverless compute compatibility.
  • Migration Guidance: Provide step-by-step guidance for migrating notebooks, jobs, and pipelines to serverless compute.
  • Workload Analysis: Identify and address migration blockers, such as RDD usage, DBFS paths, and Spark configurations.
  • Use Case: Imagine you have a large-scale data processing pipeline running on a classic cluster. Use this Skill to analyze and migrate the pipeline to serverless compute, improving performance and reducing costs.

Quick Start

Use the databricks-serverless-migration skill to analyze the compatibility of your Databricks notebook 'my_pipeline notebooks/my_pipeline.ipynb'.

Frequently Asked Questions about databricks-serverless-migration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate Databricks workloads to serverless compute?▼

Migrating Databricks workloads to serverless compute requires analyzing existing notebooks, jobs, and pipelines for compatibility, then applying step-by-step guidance to transition workloads and optimize resource usage.

What are common blockers when moving Databricks pipelines to serverless architecture?▼

Common blockers when moving Databricks pipelines to serverless architecture include RDD usage, DBFS paths, and specific Spark configurations that require analysis and remediation before successful migration.

Do I need the databricks CLI to analyze code for serverless compatibility?▼

Yes, you need the databricks CLI version 0.292.0 or higher and Databricks Connect to establish serverless sessions for analyzing code compatibility and migrating workloads.

Can I migrate large-scale data processing jobs from classic clusters to serverless?▼

Yes, you can migrate large-scale data processing jobs from classic clusters to serverless compute to improve performance, reduce costs, and optimize resource scalability.

How does compatibility analysis work for Databricks notebooks moving to serverless?▼

Compatibility analysis for Databricks notebooks moving to serverless evaluates code against serverless compute requirements, identifying workload blockers like RDD usage and DBFS paths to provide actionable migration guidance.

Related Skills

Explore More Software Engineering Skills→
databricksdatabricks
251

databricks-apps

Scaffold and deploy full-stack applications on Databricks with AppKit.

Official
Advanced
jimmc414jimmc414
557

modal

Run Python code in serverless cloud containers with GPUs and autoscaling.

Community
Advanced
alessandro9110alessandro9110
4

databricks-config

Configure Databricks authentication profiles in ~/.databrickscfg.

Community
Intermediate
itsadijmbtitsadijmbt
1

databricks-execution-compute

Routes Databricks workloads to optimal compute modes via MCP tools.

Community
Intermediate