skills.rest
patrikborosch
patrikboroschCOMMUNITY
Explore all skills by this author →
GitHub

hdinsight-migration

Migrate HDInsight Spark, Hive, and Oozie workloads to Microsoft Fabric.

14|3|Updated Mar 13, 2026
Search Tags:#delta-lake#data-migration#hdinsight#microsoft-fabric#oozie#spark-migration#hive-migration
One-click install
npx skills add https://github.com/patrikborosch/AnalyticsPlatformAgents --skill hdinsight-migration-patrikborosch
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: hdinsight-migration
Source: https://github.com/patrikborosch/AnalyticsPlatformAgents/tree/main/creator/skills/hdinsight-migration
Command: npx skills add https://github.com/patrikborosch/AnalyticsPlatformAgents --skill hdinsight-migration-patrikborosch

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates the manual, error-prone work of migrating legacy Azure HDInsight Spark clusters, Hive workloads, and Oozie orchestration to Microsoft Fabric, removing compatibility barriers between outdated HDInsight APIs and modern Fabric services.

Core Features & Use Cases

  • Legacy Spark API Modernization: Replaces deprecated HiveContext, SQLContext, and standalone SparkContext constructors with Fabric's pre-instantiated SparkSession, resolving Spark 2.x to 3.x compatibility gaps.
  • Storage Path Standardization: Converts deprecated WASB/ABFS storage paths to OneLake abfss URLs or relative Lakehouse paths via Shortcuts, eliminating the need for storage account keys or SAS tokens.
  • Hive to Delta Lake Translation: Transforms Hive DDL (ORC/Parquet tables, external tables, partitions) to Delta Lake schemas in Fabric Lakehouses, preserving data structure while gaining ACID guarantees and time travel.
  • Oozie to Fabric Pipeline Mapping: Maps all Oozie workflow action types (spark, hive, shell, sqoop, coordinator) to native Fabric Pipeline activities and schedule/storage event triggers.
  • Use Case: A data engineering team retiring an on-prem HDInsight environment can use this Skill to rewrite 100+ legacy Spark notebooks, migrate 50+ Hive tables to Delta, and replace 20+ Oozie workflows with Fabric Pipelines in a single standardized migration pass.

Quick Start

Use the hdinsight-migration skill to convert your legacy HDInsight Spark notebooks, Hive DDL, and Oozie workflows to native Microsoft Fabric equivalents.

Frequently Asked Questions about hdinsight-migration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate Hive tables to Delta Lake in Microsoft Fabric?▼

To migrate Hive DDL to Delta Lake, this Skill translates external tables and partitions into Delta Lake schemas within Fabric Lakehouses, preserving data structure while adding ACID guarantees and time travel.

What is the best way to convert legacy Spark notebooks for Microsoft Fabric?▼

The best way to convert legacy Spark notebooks is replacing deprecated HiveContext, SQLContext, and standalone SparkContext constructors with Fabric's pre-instantiated SparkSession to resolve Spark 2.x to 3.x compatibility gaps.

Can I map Oozie workflows to Fabric Pipelines?▼

Yes, you can map Oozie workflows to Fabric Pipelines by translating all Oozie action types, including spark, hive, shell, and sqoop, into native Fabric Pipeline activities with schedule and storage event triggers.

How do I convert WASB storage paths for Fabric Lakehouses?▼

Converting WASB storage paths for Fabric Lakehouses involves transforming deprecated WASB and ABFS paths to OneLake abfss URLs or relative Lakehouse paths via Shortcuts, eliminating the need for storage account keys or SAS tokens.

Does this migration approach support retiring on-prem HDInsight environments?▼

Yes, this approach supports HDInsight infrastructure retirement by standardizing the migration of legacy Spark notebooks, Hive tables, and Oozie workflows to native Microsoft Fabric equivalents in a single pass.

Related Skills

Explore More Data & Analytics Skills→
weiflycc-cmdweiflycc-cmd

hdinsight-migration

Migrate HDInsight Spark, Hive, and Oozie workloads to Microsoft Fabric.

Community
Advanced
rritecrritec
3

hdinsight-migration

Migrate HDInsight Spark and Hive workloads to Microsoft Fabric.

Community
Advanced
microsoftmicrosoft
952

hdinsight-migration

Migrate Azure HDInsight Spark and Hive workloads to Microsoft Fabric.

Official
Advanced
tomztomz

azure-hdinsight-migration-spark-to-fabric

Migrate HDInsight Spark workloads to Microsoft Fabric with an end-to-end playbook.

Community
Advanced