spark-consumption-cli
OfficialInteractive lakehouse data analysis with Spark.
Data & Analytics#pyspark#lakehouse#data-exploration#spark-sql#livy#cross-lakehouse#delta-time-travel
Authormicrosoft
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Analyze lakehouse data interactively using Fabric Lakehouse Livy API sessions and PySpark/Spark SQL for advanced analytics, DataFrames, cross-lakehouse joins, Delta time-travel, and unstructured/JSON data. Use when the user explicitly asks for PySpark, Spark DataFrames, Livy sessions, or Python-based analysis — NOT for simple SQL queries.
Core Features & Use Cases
- Interactive Lakehouse analysis with PySpark and Spark SQL across multiple lakehouses
- Manage Lakehouse Livy sessions (idle/session states) and execute statements
- Cross-lakehouse joins, Delta time-travel, and handling unstructured/JSON data
- Use cases: ad-hoc analytics, data discovery, and Python-based analytics workflows
Quick Start
Launch or reuse a Lakehouse Livy session and run Spark SQL or PySpark queries to explore lakehouse data across workspaces.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: spark-consumption-cli Download link: https://github.com/microsoft/skills-for-fabric/archive/main.zip#spark-consumption-cli Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.