skills.rest
microsoft
microsoftOFFICIAL
Explore all skills by this author →
Website𝕏@OpenAtMicrosoftGitHub

hdinsight-migration

Migrate Azure HDInsight Spark and Hive workloads to Microsoft Fabric.

952|267|Updated Feb 17, 2026
Search Tags:#migration#hive#spark#fabric#delta-lake#hdinsight#onenlake
One-click install
npx skills add https://github.com/microsoft/skills-for-fabric --skill hdinsight-migration
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: hdinsight-migration
Source: https://github.com/microsoft/skills-for-fabric/tree/main/plugins/fabric-skills/skills/hdinsight-migration
Command: npx skills add https://github.com/microsoft/skills-for-fabric --skill hdinsight-migration

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Port Azure HDInsight Spark clusters and Hive workloads to Microsoft Fabric. Replace legacy SparkContext and HiveContext usage with the pre-instantiated SparkSession, auto-migrate WASB/ABFS paths to OneLake shortcuts, and map Oozie workflows to Fabric Pipelines. It also introduces notebookutils for file/credential operations during migration and retirement of HDInsight clusters.

Core Features & Use Cases

  • HDInsight → Fabric migration of Spark notebooks, pipelines, and SQL end-to-end patterns.
  • Path migrations: convert WASB/ABFS paths to abfss OneLake shortcuts and Lakehouse tables.
  • Oozie → Fabric Pipelines: translate actions to Notebook activities, Script activities, and Copy Data tasks.
  • Delta Lake migration: convert Hive DDL to Delta Lake schemas and organize into Lakehouse schemas.

Quick Start

Use the hdinsight-migration skill to begin migrating HDInsight Spark and Hive workloads to Fabric.

Frequently Asked Questions about hdinsight-migration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate HDInsight Spark workloads to Fabric?▼

Migrate HDInsight Spark workloads to Fabric by replacing legacy SparkContext and HiveContext with the pre-instantiated SparkSession, then porting notebooks and pipelines directly into the Fabric environment.

How do I convert WASB and ABFS storage paths to OneLake during HDInsight migration?▼

Convert WASB and ABFS storage paths to OneLake by enforcing path migration to abfss OneLake shortcuts and Lakehouse tables, ensuring your Spark notebooks reference the new Delta Lake locations.

What is the best way to migrate Oozie workflows to Fabric Pipelines?▼

Migrate Oozie workflows to Fabric Pipelines by translating Oozie actions into Fabric Notebook activities, Script activities, and Copy Data tasks, replacing legacy orchestration with native Fabric pipeline operations.

How do I convert Hive DDL to Delta Lake schemas in Fabric?▼

Convert Hive DDL to Delta Lake schemas by updating Hive metastore usage to Lakehouse schemas, organizing migrated tables into the Lakehouse, and aligning library management with Fabric Environments.

Can I use notebookutils for file and credential operations when migrating from HDInsight?▼

Yes, you can use notebookutils for file and credential operations during HDInsight migration, replacing legacy file and secret access patterns across notebooks and pipelines within Fabric.

Do I need to update SparkContext usage before migrating HDInsight clusters to Fabric?▼

Yes, you must replace legacy SparkContext and HiveContext usage with the pre-instantiated SparkSession before migrating HDInsight clusters to ensure compatibility with the Fabric Spark runtime.

Related Skills

Explore More Software Engineering Skills→
weiflycc-cmdweiflycc-cmd

hdinsight-migration

Migrate HDInsight Spark, Hive, and Oozie workloads to Microsoft Fabric.

Community
Advanced
rritecrritec
3

hdinsight-migration

Migrate HDInsight Spark and Hive workloads to Microsoft Fabric.

Community
Advanced
microsoftmicrosoft
952

databricks-migration

Translate Databricks Unity Catalog structures, notebooks, jobs, and pipelines to Fabric equivalents.

Official
Advanced
patrikboroschpatrikborosch
14

hdinsight-migration

Migrate HDInsight Spark, Hive, and Oozie workloads to Microsoft Fabric.

Community
Advanced