rill-model

What problem does it solve?

This Skill provides comprehensive guidance on creating, configuring, and optimizing data models within the Rill data platform, enabling efficient data transformation and ingestion.

Core Features & Use Cases

• Model Definition: Understand the structure and properties for defining Rill models, including SQL queries, materialization, and incremental loading.
• Data Partitioning: Learn how to implement glob-based and SQL-based partitioning for scalable data ingestion.
• Incremental Ingestion: Configure state-based and partition-based incremental strategies for efficient data updates.
• Development Best Practices: Utilize dev partitions and understand performance considerations for faster iteration.
• Use Case: A data engineer needs to build a daily aggregated sales report from raw transaction data. They would use this Skill to define a Rill model that incrementally loads new sales data, joins it with product information, and materializes it into a performant table for dashboard consumption.

Quick Start

Use the rill-model skill to learn how to define a materialized model that reads from a BigQuery table and outputs to ClickHouse.