airbyte
CommunitySync data from any source to your warehouse
Software Engineering#terraform#incremental sync#elt#airbyte#deduped upsert#dbt normalization#airflow orchestration
Authorivanshamaev
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Airbyte ELT helps teams reliably move data from sources to destinations while supporting full refresh and incremental syncing, including deduped incremental upserts and schema evolution handling.
Core Features & Use Cases
- Connection, stream, and catalog design: Configure sources, destinations, connections, streams, and sync schedules using Airbyte’s catalog metadata.
- Sync mode coverage: Apply Full Refresh Overwrite/Append and Incremental Append/Append+Deduped with cursor fields and primary keys.
- Raw-to-normalized workflow: Land raw records into
_airbyte_raw_/ meta-enriched structures and optionally perform dbt-based basic normalization for typed tables. - Operational automation: Manage connections via Airbyte REST API or Terraform and orchestrate syncs from Apache Airflow.
- Schema evolution & monitoring: Use non-breaking schema update policies, understand breaking change behavior, and monitor sync health through UI logs and metrics.
Quick Start
Use the airbyte skill to design an Airbyte pipeline that syncs a PostgreSQL “orders” source into Snowflake using Incremental Append + Deduped with updated_at as the cursor and order_id as the primary key.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: airbyte Download link: https://github.com/ivanshamaev/de-agent-skills/archive/main.zip#airbyte Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.