infra-aws-data-platform-review

What problem does it solve?

This Skill helps you review and design an AWS-native data platform by covering the security, architecture, service trade-offs, and cost controls that commonly break production pipelines.

Core Features & Use Cases

• S3 data lake architecture review: Validate lifecycle tiering (Bronze/Silver/Gold), encryption with KMS, public access blocking, and safe governance patterns.
• IAM and access control auditing: Ensure least-privilege access for data pipelines using IRSA (service accounts) and Lake Formation for fine-grained row/column security.
• Service selection and operational trade-offs: Compare EMR vs Glue ETL approaches, MWAA vs self-managed Airflow on EKS, and Redshift vs Athena for analytics workloads.
• Streaming and orchestration guidance: Review MSK Kafka configuration (TLS, IAM auth, encryption at rest) and containerized pipeline execution with EKS networking and IRSA alignment.
• Networking and cost optimization checklist: Confirm VPC endpoint strategy (S3/Glue), private subnet design, and practical savings via Intelligent-Tiering and Spot capacity.

Quick Start

Ask the AI: "Review our AWS data platform architecture and tell us what to change for S3 security, IAM least-privilege, MSK settings, Lake Formation controls, and the best ETL/analytics service choices."