etl-sync-job-builder

Name: etl-sync-job-builder
Availability: InStock
Author: camilo8902

Design ETL and data synchronization jobs with incremental updates and retry logic.

Updated Jan 24, 2026

Search Tags:#data pipeline #etl #data sync #idempotency #incremental sync #watermark

Ready to run

npx skills add https://github.com/Camilo8902/GabyCosmetics --skill etl-sync-job-builder-camilo8902

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: etl-sync-job-builder
Source: https://github.com/Camilo8902/GabyCosmetics/tree/main/.claude/skills/etl-sync-job-builder
Command: npx skills add https://github.com/Camilo8902/GabyCosmetics --skill etl-sync-job-builder-camilo8902

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the creation of robust ETL and data synchronization jobs, ensuring data consistency and reliability through incremental updates and error handling.

Core Features & Use Cases

Incremental Data Sync: Efficiently syncs data by only processing new or updated records since the last run, using a watermark strategy.
Idempotency: Jobs are designed to be safely re-runnable without causing duplicate data or unintended side effects.
Error Handling & Retries: Includes built-in retry logic with exponential backoff and strategies for conflict resolution.
Use Case: Automatically sync customer data from a transactional database to a data warehouse every hour, ensuring the warehouse is always up-to-date with minimal load on the source.

Quick Start

Use the etl-sync-job-builder skill to design an ETL job that syncs user data from a database to a data warehouse.

Frequently Asked Questions about etl-sync-job-builder

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I build an ETL data pipeline with incremental sync and idempotency?▼

To build an ETL data pipeline with incremental sync and idempotency, design jobs that track watermarks to process only new or updated records, ensuring safe re-runs without duplicating data.

What is watermark tracking used for in data synchronization jobs?▼

Watermark tracking in data synchronization jobs is used to capture the timestamp of the last processed record, enabling incremental updates by fetching only new data on the next run.

How do I handle conflict resolution and error retries in a data sync job?▼

To handle conflict resolution and error retries in a data sync job, implement built-in retry logic with exponential backoff and specific strategies to resolve data conflicts during synchronization.

Does Change Data Capture work for syncing transactional databases to a data warehouse?▼

Yes, Change Data Capture (CDC) works for syncing transactional databases to a data warehouse by efficiently identifying and transferring only the changed records to keep the warehouse updated.

Why does my data sync job create duplicate records when re-running?▼

Your data sync job creates duplicate records when re-running because it lacks idempotency guarantees, meaning the job design must ensure operations can be safely repeated without unintended side effects.