skills.rest
sakicodes
sakicodesCOMMUNITY
Explore all skills by this author →
GitHub

exporting-rds-to-s3

Exports RDS and Aurora database snapshots to S3 in Apache Parquet format.

Updated Jul 1, 2026
Search Tags:#aws#s3#rds#parquet#athena#aurora#snapshot export
One-click install
npx skills add https://github.com/sakicodes/BuildFestHackathon26 --skill exporting-rds-to-s3-sakicodes
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: exporting-rds-to-s3
Source: https://github.com/sakicodes/BuildFestHackathon26/tree/main/.agents/skills/exporting-rds-to-s3
Command: npx skills add https://github.com/sakicodes/BuildFestHackathon26 --skill exporting-rds-to-s3-sakicodes

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Moving data out of Amazon RDS or Aurora for analytics, backup, or migration normally requires manual ETL pipelines. This Skill automates the native snapshot export workflow so database contents land in S3 as Parquet files ready for Athena, Glue, or Redshift Spectrum. ## Core Features & Use Cases - End-to-End Export Workflow: Handles snapshot selection or creation, IAM role setup with confused deputy protection, KMS encryption, S3 bucket preparation, export task execution, and progress monitoring. - Selective Table Export: Supports exporting specific tables or entire databases, with validation of table naming conventions per engine. - Verification and Access Guidance: Verifies exported Parquet files in S3 and provides query instructions for Athena, Glue crawlers, Redshift Spectrum, and local pandas/pyarrow access. - Use Case: Export a production Aurora PostgreSQL cluster snapshot to S3, then create an Athena external table to run analytics queries without loading a live database. ## Quick Start Export the latest snapshot of my RDS instance production-mysql in us-east-1 to the S3 bucket my-rds-exports and show me how to query it with Athena.

Frequently Asked Questions about exporting-rds-to-s3

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I export an RDS snapshot to S3?▼

Use the aws rds start-export-task command with the snapshot ARN, target S3 bucket, IAM role, and optional KMS key. The export converts the snapshot to Parquet files organized by schema and table under the specified S3 prefix.

How to export an Aurora cluster snapshot to S3 for Athena?▼

Export the Aurora cluster snapshot using start-export-task with the cluster-snapshot ARN, then create an Athena external table with STORED AS PARQUET pointing at the export path. Athena queries the Parquet files directly at roughly $5 per TB scanned.

Which database engines support RDS snapshot export to S3?▼

Snapshot export supports MySQL, PostgreSQL, MariaDB, Aurora MySQL, and Aurora PostgreSQL. Oracle and SQL Server are not supported by the native RDS export feature.

Why does my RDS export task fail with IAM permission errors?▼

The IAM role must trust export.rds.amazonaws.com with aws:SourceAccount and aws:SourceArn conditions, and have s3:PutObject plus kms:Decrypt and kms:GenerateDataKey permissions. Wait 10-15 seconds after role creation for IAM propagation before starting the export.

Can I export only specific tables from an RDS snapshot?▼

Yes, pass a comma-separated list in schema.table format via the --export-only parameter. Table names are case-sensitive, must match exactly, and dependent tables are not included automatically, so invalid names cause the export to fail.

How long does an RDS snapshot export to S3 take?▼

Export speed is roughly 10-20 GB per hour depending on snapshot size, so a 100 GB snapshot takes about 5-10 hours. The task runs asynchronously in AWS, so you can close your session and check status later with describe-export-tasks.

Related Skills

Explore More Software Engineering Skills→
richardnromanrichardnroman

creating-amazon-aurora-db-cluster-with-instances

Creates Amazon Aurora clusters with instances and Secrets Manager password management.

Community
Intermediate
richardnromanrichardnroman

exporting-rds-to-s3

Exports RDS and Aurora snapshots to S3 in Apache Parquet format.

Community
Advanced
awslabsawslabs
15

s3

Optimizes Amazon S3 bucket configuration, access control, and lifecycle policies for secure, cost-effective storage management.

Official
Advanced
k2worksk2works

operating-backup

Back up and restore AWS RDS and PostgreSQL databases via snapshots and pg_dump.

Community
Intermediate