oxy-etl-builder

Automate ETL pipeline creation and extension with DLT for API and spreadsheet sources.

1|1|Updated Dec 19, 2025
One-click install
npx skills add https://github.com/oxy-hq/skills --skill oxy-etl-builder
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: oxy-etl-builder
Source: https://github.com/oxy-hq/skills/tree/main/skills/oxy-etl-builder
Command: npx skills add https://github.com/oxy-hq/skills --skill oxy-etl-builder

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Build and extend end-to-end ETL pipelines using DLT, accelerating delivery from API and spreadsheet sources to data warehouses.

Core Features & Use Cases

  • Scaffold ETL project skeleton (core/, sources/, runners/, transforms/)
  • Generate API connectors and spreadsheet ingestion templates
  • Support chunked backfill, incremental loading, and multi-warehouse deployment
  • Provide CLI runner patterns and metrics hooks for production readiness

Quick Start

Run the ETL Pipeline Builder to scaffold a full ETL project with API connectors or spreadsheet ingestion.

Frequently Asked Questions about oxy-etl-builder

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build robust ETL pipelines from API connectors and spreadsheets?

You build robust ETL pipelines by using DLT to automate API connector generation, spreadsheet ingestion templates, and project scaffolding. This enforces a standardized directory structure and handles chunked backfill for your data workflows.

Does this ETL pipeline builder support deployment to Snowflake and ClickHouse?

Yes, the ETL pipeline builder supports multi-warehouse deployment across ClickHouse, Snowflake, MotherDuck, and DuckDB. It provides CLI-driven runners and metrics hooks to ensure production readiness across these target data warehouses.

What is the best way to handle incremental loading and chunked backfills in a DLT pipeline?

The best way to handle incremental loading and chunked backfills is to use automated templates that manage source classification and data chunking. This approach handles large data volumes efficiently and includes post-load metrics hooks for monitoring pipeline execution.

Can I extend an existing ETL setup without restructuring the entire project?

Yes, you can extend existing ETL setups by adding new API connectors and spreadsheet ingestion templates without restructuring the entire project. The builder supports both new projects and existing configurations while maintaining a standardized project structure.

Do I need to manually configure CLI runners for my data pipelines?

No, you do not need to manually configure CLI runners because the builder provides CLI-driven runner patterns automatically. It scaffolds the ETL project skeleton and includes post-load metrics hooks to ensure your data pipelines are production-ready.