Automate data ingestion pipelines from APIs, databases, and files into destinations.
npx skills add https://github.com/clawdata/clawdata --skill dlt-clawdata
Please help me install this Agent Skill. Skill: dlt Source: https://github.com/clawdata/clawdata/tree/main/skills/dlt Command: npx skills add https://github.com/clawdata/clawdata --skill dlt-clawdata
Build data ingestion pipelines with dlt to extract data from APIs, databases, and files and load it into a destination data store for analytics.
Install the dlt package, create a simple pipeline, and run it to ingest data.
High-intent search queries and answers about installing and using this skill.
You can build a data ingestion pipeline by initializing it with simple commands to extract data from APIs and load it directly into SQL databases. This automates end-to-end ETL processes for analytics teams using various sources.
Automating incremental loading is handled natively by the pipeline execution flow. It ingests data from APIs, databases, and files, applying incremental loads to efficiently update destinations like DuckDB, PostgreSQL, or Snowflake.
Yes, this data ingestion approach supports deploying pipelines to BigQuery, Snowflake, and Redshift. It also loads data into DuckDB, PostgreSQL, and Databricks for analytics workflows.
To set up an ETL pipeline, install the required Python library, initialize the pipeline, and run it to ingest data from APIs, SQL databases, and files. This automates extraction and loading into your specified data destinations.
Yes, you can extract data from SQL databases and load it into DuckDB or Databricks. The pipeline supports multiple data sources and destinations, enabling automated ELT workflows across different environments.
dlt-hubGenerate a dlt pipeline for ingesting data from a REST API source.
GACLoveGenerate SQL queries across PostgreSQL, Snowflake, BigQuery, Redshift, and Databricks dialects.
CatsofsufferingManage and validate data pipelines and streaming workflows across orchestration and quality tools.
claude-office-skillsDesign and automate ETL pipelines from SQL, NoSQL, APIs, and files to BigQuery and Snowflake.
