What problem does it solve?
This Skill automates the creation, management, and refresh of Materialized Lake Views (MLVs) in Microsoft Fabric using Spark and PySpark, simplifying the process of materializing and refreshing declarative SQL/PySpark transformations that persist as Delta tables.
Core Features & Use Cases
- MLV Creation: Automates the process of creating MLVs with Spark SQL and PySpark.
- Management: Handles tasks like showing, altering, renaming, and dropping MLVs.
- Refresh: Manages refresh strategies, including full, incremental, and skip refreshes.
- Data Quality: Implements data quality rules and provides a data quality report.
- Use Case: Streamline the creation of data pipelines and materialized datasets for reporting, without the need for complex orchestration.
Quick Start
Use the fabric-mlv skill to create a new MLV with the following Spark SQL command: CREATE MATERIALIZED LAKE VIEW silver.new_mlv AS SELECT * FROM bronze.source_table.