What problem does it solve?
Managing Microsoft Fabric Dataflows Gen2 through the web UI is slow, repetitive, and difficult to integrate into automated data engineering pipelines. This Skill eliminates manual toil by providing a complete CLI-driven authoring workflow for creating, updating, previewing, and refreshing dataflows, including connection management and output destination configuration.
Core Features & Use Cases
- Full CRUD Operations: Create, read, update, and delete Fabric Dataflows Gen2 via the Azure CLI against the Fabric REST API.
- Connection Lifecycle Management: Discover, create, validate, and bind Fabric connections to dataflows, including ClusterId resolution for composite binding.
- Preview-Driven Authoring: Evaluate candidate Power Query M documents via the executeQuery endpoint before persisting changes, catching syntax and credential errors early.
- Output Destinations: Configure dataflows to write results to Lakehouse tables or files, Warehouse, Azure Data Explorer, or Azure SQL using DataDestinations annotations.
- Robust Error Handling: Includes long-running operation polling patterns, connection validation pre-refresh checks, and troubleshooting guides for common API failures.
Quick Start
Use the dataflows-authoring-cli skill to create a new Fabric dataflow named "SalesETL" in the "analytics-prod" workspace that writes transformed sales data to the "SalesLakehouse" Lakehouse table.