fabric-delta-spark-perf

Community

Diagnose and optimize Delta Lake + Spark in Fabric.

AuthorPatrickGallucci
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Delta Lake and Spark performance can degrade over time in Fabric Lakehouses due to small files, data skew, and suboptimal configurations. This Skill provides a structured diagnostic workflow and actionable remediation to restore throughput and reduce latency.

Core Features & Use Cases

  • End-to-end diagnostics for Delta Lake on Fabric: file health checks, partition assessment, data skew analysis, and Spark config audit.
  • Recommended optimizations: OPTIMIZE, VACUUM, V-Order / Z-Order, Optimized Write, and AQE tuning, plus resource-profile guidance.
  • Real-world scenarios: slow Spark notebooks, heavy shuffle workloads, and Direct Lake-backed tables.

Quick Start

Activate the skill and run the diagnostic against your Delta Lake table or schema to identify issues, then apply recommended optimizations such as OPTIMIZE, VACUUM, and AQE tuning.

Dependency Matrix

Required Modules

pysparkdelta-spark

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: fabric-delta-spark-perf
Download link: https://github.com/PatrickGallucci/fabric-skills/archive/main.zip#fabric-delta-spark-perf

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.