skills.rest
rritec
rritecCOMMUNITY
Explore all skills by this author →
Website𝕏@rritecGitHub

spark-authoring-cli

Manage Microsoft Fabric Spark authoring tasks and generate notebook-ready code.

3|6|Updated Jun 21, 2024
Search Tags:#data engineering#rest api#spark#pyspark#lakehouse#microsoft fabric#notebook authoring
One-click install
npx skills add https://github.com/rritec/Microsoft-Fabric --skill spark-authoring-cli-rritec
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: spark-authoring-cli
Source: https://github.com/rritec/Microsoft-Fabric/tree/main/skills/plugins/fabric-authoring/skills/spark-authoring-cli
Command: npx skills add https://github.com/rritec/Microsoft-Fabric --skill spark-authoring-cli-rritec

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you manage Microsoft Fabric Spark assets and write notebook cell code without manually stitching together REST calls, lakehouse bindings, and Spark configuration.

Core Features & Use Cases

  • Workspace and lakehouse management: Discover, create, and manage Fabric workspaces, lakehouses, notebooks, jobs, and pipelines through the control plane.
  • Notebook code authoring: Generate and debug PySpark, Scala, SparkR, and SQL code for Fabric notebook cells with correct Spark and lakehouse context.
  • Operational guidance: Apply rules for job monitoring, session configuration, notebook updates, and infrastructure provisioning to reduce errors and duplicate runs.
  • Use case: A data engineer can ask for a new notebook, a lakehouse binding update, and a Spark transformation pattern in one workflow instead of assembling each piece manually.

Quick Start

Ask me to create, update, or debug a Microsoft Fabric Spark notebook, workspace, or lakehouse workflow and I will route the task to the right Fabric instructions and code patterns.

Frequently Asked Questions about spark-authoring-cli

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate PySpark code for Microsoft Fabric notebooks?▼

To generate PySpark code for Fabric notebooks, request notebook cell authoring with the correct Spark and lakehouse context. The Skill produces notebook-ready PySpark, Scala, SparkR, or SQL code without manual REST API stitching.

How do I manage lakehouse bindings in a Fabric workspace?▼

Managing Fabric lakehouse bindings requires correct REST API usage and validation. This Skill handles workspace and lakehouse management, ensuring proper binding validation and reducing configuration errors.

Can I set up a Fabric Spark workspace and pipeline in one workflow?▼

Yes, you can set up a Fabric Spark workspace, lakehouse, notebook, and pipeline in one workflow. The Skill routes infrastructure provisioning and pipeline design requests to the correct Fabric control plane instructions.

What is the best way to debug Spark session configuration in Fabric?▼

Debugging Spark session configuration in Fabric involves applying operational rules for session setup and job monitoring. This Skill provides configuration guidance to reduce duplicate runs and prevent session errors.

Does this approach support SQL and Scala alongside PySpark for lakehouse workflows?▼

Yes, the approach supports SQL, Scala, and SparkR alongside PySpark for lakehouse workflows. The Skill generates and debugs code for Fabric notebook cells while maintaining the correct Spark and lakehouse context.

Related Skills

Explore More Data & Analytics Skills→
rritecrritec
3

spark-consumption-cli

Analyze Microsoft Fabric lakehouse data with interactive PySpark sessions and Spark SQL.

Community
Advanced
markus41markus41
12

Fabric Data Factory

Automate end-to-end data integration and orchestration in Microsoft Fabric Data Factory.

Community
Advanced
weiflycc-cmdweiflycc-cmd

spark-authoring-cli

Manage Microsoft Fabric Spark workloads and author PySpark, Scala, and SQL notebooks via REST API patterns.

Community
Advanced
rritecrritec
3

synapse-migration

Migrate Azure Synapse Spark workspaces into Microsoft Fabric with validation and reporting.

Community
Advanced