connecting-to-data-source

What problem does it solve?

This Skill eliminates the trial-and-error involved in wiring AWS Glue to external databases and warehouses by creating a reusable, tested AWS Glue connection with correct networking and credentials references.

Core Features & Use Cases

• Glue connection creation with validation: Creates an AWS Glue connection for JDBC sources (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora, Redshift) and native connections for Snowflake and BigQuery, then tests it before handoff.
• Credential best practices: Guides selection of IAM DB auth when supported and strongly prefers Secrets Manager over plaintext credentials, including correct secret key conventions per source type.
• Network + troubleshooting guardrails: Ensures VPC/Subnet/Security Group/S3 endpoint readiness for private sources and provides an ordered troubleshooting flow when tests fail.
• Use Case: Register an existing RDS/PostgreSQL instance (or Snowflake/BigQuery project) as a named Glue connection so downstream ingestion jobs can reliably read from it without reconfiguring networking and auth each time.

Quick Start

Ask the AI to create a Glue connection for your PostgreSQL on RDS by running: connect to data source with source-type postgresql, connection name oracle-prod-sales, hostname <rds-endpoint>, and the secrets manager secret to use.