skills.rest
tomz
tomzCOMMUNITY
Explore all skills by this author →
Website𝕏@tomzengGitHub

azure-hdinsight-migration-interactive-query-to-fabric-spark-or-dw

Migrate HDInsight Interactive Query workloads to Microsoft Fabric with schema and data compatibility.

Updated Apr 27, 2026
Search Tags:#migration#hive#delta#spark#fabric#tsql#hdinsight
One-click install
npx skills add https://github.com/tomz/agent-skills --skill azure-hdinsight-migration-interactive-query-to-fabric-spark-or-dw
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: azure-hdinsight-migration-interactive-query-to-fabric-spark-or-dw
Source: https://github.com/tomz/agent-skills/tree/main/azure-hdinsight-migration-interactive-query-to-fabric-spark-or-dw
Command: npx skills add https://github.com/tomz/agent-skills --skill azure-hdinsight-migration-interactive-query-to-fabric-spark-or-dw

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Migrates HDInsight Interactive Query workloads (Hive LLAP/Tez) to Microsoft Fabric, aligning with modern data fabric architectures to reduce operational risk and unlock lakehouse/warehouse capabilities.

Core Features & Use Cases

  • Decision matrix guiding Lakehouse SQL Endpoint vs Fabric Warehouse based on workload patterns.
  • Migration patterns including shortcut, ORC→Delta conversion, and pipeline copy, plus SQL/DDL translation across Spark and T-SQL surfaces.
  • End-to-end guidance for translating HiveQL/Hive features to Spark SQL and T-SQL equivalents, Beeline/JDBC cutover, and UDF considerations.

Quick Start

Inventory HDInsight objects, map them to Fabric targets, provision Lakehouse and Warehouse resources, and run a pilot migration for a representative subset of tables.

Frequently Asked Questions about azure-hdinsight-migration-interactive-query-to-fabric-spark-or-dw

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I migrate Hive LLAP workloads from HDInsight to Fabric?▼

Migrating Hive LLAP workloads to Fabric requires inventorying source objects, translating HiveQL DDL to Spark SQL or T-SQL, and converting ORC ACID tables to Delta format for Lakehouse SQL Endpoint or Fabric Warehouse.

When should I choose Fabric Lakehouse SQL Endpoint vs Fabric Warehouse for HDInsight migration?▼

Choosing between Lakehouse SQL Endpoint and Fabric Warehouse depends on workload patterns; Lakehouse uses Delta with Direct Lake for read-heavy analytics, while Warehouse provides T-SQL and ACID compliance for transactional writes.

What is the best way to translate Hive UDFs for Fabric Spark and T-SQL?▼

Translating Hive UDFs involves evaluating compatibility across Spark SQL and T-SQL surfaces, requiring custom function rewrites or equivalent logic implementation to maintain read/write parity during Beeline and JDBC cutover.

How do I convert ORC ACID tables to Delta format during HDInsight migration?▼

Converting ORC ACID tables to Delta format uses pipeline copy or shortcut migration patterns, transforming data to Delta tables accessible via the Fabric Lakehouse SQL Endpoint.

Does HDInsight Interactive Query migration to Fabric support Beeline JDBC cutover?▼

HDInsight Interactive Query migration supports Beeline and JDBC cutover by mapping existing connection strings and query patterns to Fabric Spark SQL or Warehouse T-SQL endpoints.

What are the limitations of migrating Hive Tez workloads to Fabric Spark?▼

Limitations of migrating Hive Tez workloads include potential UDF incompatibilities, syntax differences between HiveQL and Spark SQL, and the need to validate read/write parity across engines to ensure query accuracy.

Related Skills

Explore More Data & Analytics Skills→
tomztomz

azure-hdinsight-migration-spark-to-fabric

Migrate HDInsight Spark workloads to Microsoft Fabric with an end-to-end playbook.

Community
Advanced
abdullah1854abdullah1854
1

fabric-helper

Generate Delta Lake and Spark SQL queries for Fabric Lakehouse and Warehouse.

Community
Intermediate
markus41markus41
12

Fabric Data Factory

Automate end-to-end data integration and orchestration in Microsoft Fabric Data Factory.

Community
Advanced
weiflycc-cmdweiflycc-cmd

synapse-migration

Automate Azure Synapse Analytics workload migration to Microsoft Fabric.

Community
Intermediate