Skills
.Work. You
Rest

trino-airflow-orchestration

Community

Orchestrate Trino pipelines safely in Airflow.

Software Engineering#orchestration#trino#dbt integration#iceberg#apache airflow#incremental loads#idempotent pipelines
Authorivanshamaev
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill solves the problem of reliably scheduling and operating Trino SQL data pipelines with correct connection management, retries, idempotency, and operational observability in Apache Airflow.

Core Features & Use Cases

  • Airflow-to-Trino integration: Use TrinoOperator and TrinoHook with a configurable trino_conn_id (including example connection setup).
  • Idempotent DAG patterns: Make reruns safe using partition-aware DELETE+INSERT and MERGE upserts with deterministic run semantics.
  • Incremental, partition-aware orchestration: Drive loads using Airflow logical dates ({{ ds }}), guard with freshness checks, and include maintenance steps like ANALYZE.
  • Production operations: Provide SLA monitoring hooks, retry configuration guidance, and anti-pattern avoidance for common failure modes.

Quick Start

Use the trino-airflow-orchestration skill to generate an Airflow DAG that runs an idempotent Trino MERGE incremental load for a given {{ ds }} partition and includes SLA monitoring and retry settings for the Trino tasks.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: trino-airflow-orchestration
Download link: https://github.com/ivanshamaev/de-agent-skills/archive/main.zip#trino-airflow-orchestration

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.