spark-consumption-cli

Official

Interactive lakehouse data analysis with Spark.

Authormicrosoft
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Analyze lakehouse data interactively using Fabric Lakehouse Livy API sessions and PySpark/Spark SQL for advanced analytics, DataFrames, cross-lakehouse joins, Delta time-travel, and unstructured/JSON data. Use when the user explicitly asks for PySpark, Spark DataFrames, Livy sessions, or Python-based analysis — NOT for simple SQL queries.

Core Features & Use Cases

  • Interactive Lakehouse analysis with PySpark and Spark SQL across multiple lakehouses
  • Manage Lakehouse Livy sessions (idle/session states) and execute statements
  • Cross-lakehouse joins, Delta time-travel, and handling unstructured/JSON data
  • Use cases: ad-hoc analytics, data discovery, and Python-based analytics workflows

Quick Start

Launch or reuse a Lakehouse Livy session and run Spark SQL or PySpark queries to explore lakehouse data across workspaces.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: spark-consumption-cli
Download link: https://github.com/microsoft/skills-for-fabric/archive/main.zip#spark-consumption-cli

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.