skills.rest
miyake-san
miyake-sanCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

fabric-lakehouse

Design and optimize Microsoft Fabric Lakehouse solutions with Delta tables, shortcuts, and PySpark patterns.

Updated Aug 28, 2026
Search Tags:#data engineering#etl#pyspark#lakehouse#delta lake#onelake#microsoft fabric
One-click install
npx skills add https://github.com/miyake-san/sogo-agent-platform --skill fabric-lakehouse-miyake-san
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: fabric-lakehouse
Source: https://github.com/miyake-san/sogo-agent-platform/tree/main/skills/domain/fabric-lakehouse
Command: npx skills add https://github.com/miyake-san/sogo-agent-platform --skill fabric-lakehouse-miyake-san

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Working with Microsoft Fabric Lakehouse requires understanding its storage model, security layers, shortcuts, and optimization commands, and this Skill provides that context plus ready-to-use PySpark code patterns so you avoid trial-and-error when designing Lakehouse solutions. ## Core Features & Use Cases - Lakehouse Architecture Guidance: Explains Delta tables, schemas, Files storage, SQL endpoints, shortcuts, and materialized views in Microsoft Fabric. - PySpark Code Patterns: Provides examples for reading and writing Delta tables, CRUD operations, MERGE upserts, incremental loads, and SCD Type 2 dimensions. - Performance Optimization: Covers V-Order, OPTIMIZE with Z-ordering, and VACUUM commands for maintaining Delta table performance. - Use Case: A data engineer building a medallion architecture in Fabric can use this Skill to structure bronze/silver/gold layers, implement incremental MERGE loads, and schedule table optimization. ## Quick Start Explain how to design a Fabric Lakehouse with schemas and shortcuts, and show me PySpark code for an incremental load into a Delta table.

Frequently Asked Questions about fabric-lakehouse

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write data to a Delta table in Microsoft Fabric Lakehouse?▼

Use PySpark with df.write.format("delta").mode("overwrite").saveAsTable("table_name") to create a managed Delta table. You can also partition by columns, append to existing tables, or use MERGE for upserts.

What are Lakehouse shortcuts in Microsoft Fabric?▼

Shortcuts are virtual links to data without copying it. They support internal links to other Fabric lakehouses, ADLS Gen2, Amazon S3, Google Cloud Storage, and Dataverse, enabling cross-workspace and cross-cloud data access.

How do I optimize Delta table performance in Fabric Lakehouse?▼

Enable V-Order for read optimization, run OPTIMIZE to compact small files, apply ZORDER BY on frequently queried columns, and use VACUUM to remove old files. Regular maintenance keeps query performance stable as data grows.

Does Fabric Lakehouse support row-level and column-level security?▼

Yes, Lakehouse supports column-level and row-level security on tables in addition to OneLake permissions based on Microsoft Entra ID and RBAC. Workspace roles and sharing control item-level access.

How do I implement incremental data loads in a Lakehouse?▼

Track a watermark such as the maximum processed timestamp, filter new records from the source table against it, then use a MERGE statement to upsert matching rows and insert new ones into the target Delta table.

Related Skills

Explore More Data & Analytics Skills→
markus41markus41
12

Fabric Data Factory

Automate end-to-end data integration and orchestration in Microsoft Fabric Data Factory.

Community
Advanced
Umbral-BotUmbral-Bot

power-bi

Design Power BI reports with DAX measures, Power Query transformations, and REST API integrations.

Official
Advanced
markus41markus41
12

Fabric Data Warehouse

Provision Fabric Data Warehouse resources and author T-SQL DDL/DML.

Community
Advanced
nexscope-ainexscope-ai
38

ecommerce.temu-store-source-query

Query the NexScope marketplace gateway for filtered Temu store performance data.

Official
Intermediate