dbt

What problem does it solve?

This Skill provides expert guidance for using dbt (data build tool) with Treasure Data Trino, solving the complexity of setting up, configuring, and optimizing data transformations. It helps users overcome common issues like Trino adapter incompatibilities and ensures efficient, reliable data pipelines.

Core Features & Use Cases

• TD-Specific Setup: Guides on installing dbt, configuring profiles.yml and dbt_project.yml for Treasure Data Trino, ensuring a smooth integration.
• Macro Overrides: Provides essential dbt-trino macro overrides to ensure compatibility with TD's Trino engine, preventing common errors like "This connector does not support creating views."
• Incremental Models: Offers patterns and macros for building efficient incremental models using TD_INTERVAL to process only new data, saving time and compute resources.
• Use Case: A data engineer needs to build a robust daily ETL pipeline that transforms raw event data into aggregated metrics. This skill helps them set up dbt, define incremental models, and integrate with TD Workflows, ensuring data is processed efficiently and reliably every day.

Quick Start

Install dbt and connect to TD

uv pip install dbt-core dbt-trino==1.9.3

Configure profiles.yml with your TD API key

Then, in your dbt project directory, run:

dbt debug dbt run