What problem does it solve?
This Skill eliminates the tedious, error-prone manual work of managing Microsoft Fabric Spark resources, writing and debugging notebook code, and designing data pipelines or infrastructure, which requires deep knowledge of Fabric REST APIs, Spark best practices, and lakehouse configuration rules.
Core Features & Use Cases
- Fabric Resource Management: Automate provisioning and management of workspaces, lakehouses, notebooks, jobs, and pipelines via guided REST API patterns.
- Notebook Code Authoring: Write, debug, and deploy PySpark, Scala, SparkR, and SQL notebook cells with correct lakehouse bindings, proper formatting, and Fabric-specific runtime rules.
- Data Engineering Best Practices: Implement Delta Lake optimization, medallion architecture patterns, data quality checks, and CI/CD deployment workflows for production-grade Spark workloads.
- Use Case: A data engineer can use this Skill to set up a new dev workspace with a configured lakehouse, write a PySpark notebook to ingest raw public data into a bronze Delta table, and deploy it to Fabric with correct bindings and performance configs.
Quick Start
Use the spark-authoring-cli skill to create a new Fabric workspace with a lakehouse and deploy a PySpark notebook that ingests public NYC taxi data into a Delta table following medallion architecture best practices.
