ingesting-into-data-lake

Ingest data from S3, JDBC, Snowflake, BigQuery, DynamoDB, and Glue catalogs into AWS data lakes.

2.3k|234|Updated Apr 23, 2026
One-click install
npx skills add https://github.com/aws/agent-toolkit-for-aws --skill ingesting-into-data-lake-aws
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ingesting-into-data-lake
Source: https://github.com/aws/agent-toolkit-for-aws/tree/main/plugins/aws-data-analytics/skills/ingesting-into-data-lake
Command: npx skills add https://github.com/aws/agent-toolkit-for-aws --skill ingesting-into-data-lake-aws

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Ingesting data from multiple sources into a centralized AWS data lake is streamlined with clear guidance, guardrails, and repeatable ingestion patterns.

Core Features & Use Cases

  • Supports ingestion from S3 files, local uploads, JDBC sources, Snowflake, BigQuery, DynamoDB, and existing Glue catalogs into S3 Tables or Iceberg.
  • Handles one-time loads and recurring pipelines, including migrations, with schema evolution and data quality checks.
  • Use cases include consolidating heterogeneous data sources into analytics-ready tables and accelerating data-driven decision making.

Quick Start

Create a Glue-based ingest pipeline to move a sample CSV from S3 into an S3 Tables sink.

Frequently Asked Questions about ingesting-into-data-lake

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest data from JDBC sources into an AWS data lake?

You can ingest data from JDBC sources into an AWS data lake by defining source discovery, validating connections, and using Glue pipelines to load data into S3 Tables or Iceberg sinks with schema handling and data quality checks.

Can I load data from Snowflake and BigQuery into S3 Tables using Glue?

Yes, you can load data from Snowflake and BigQuery into S3 Tables using Glue. The ingestion process includes source discovery, connection validation, target selection, and data quality checks to ensure reliable data movement.

What is the best way to set up recurring data lake ingestion pipelines in AWS?

The best way to set up recurring data lake ingestion pipelines in AWS is using Glue to automate data movement from diverse sources into Iceberg or S3 Tables, handling schema evolution and data quality checks for reliable, auditable pipelines.

Does this data lake ingestion approach support schema evolution and data quality checks?

Yes, this data lake ingestion approach supports schema evolution and data quality checks. It ensures reliable, auditable data movement into S3 Tables or Iceberg from sources like S3 files, DynamoDB, and existing Glue catalogs.

Can I ingest DynamoDB data into an Iceberg data lake?

Yes, you can ingest DynamoDB data into an Iceberg data lake. The process handles source discovery, connection validation, target selection, and data quality checks to move data reliably into your scalable AWS data lake.

How do I migrate local files into an S3 Tables data lake?

You can migrate local files into an S3 Tables data lake by using local uploads within a Glue-based ingest pipeline. The process validates connections, handles schemas, and applies data quality checks for reliable data movement.