skills.rest
ivanshamaev
ivanshamaevCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

infra-aws-data-platform-review

Audit AWS data platform architecture for S3, IAM, Lake Formation, and service trade-offs.

14|1|Updated May 5, 2026
Search Tags:#aws#data platform#vpc networking#lake formation#iam irsa#msk kafka#s3 lifecycle
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill infra-aws-data-platform-review
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: infra-aws-data-platform-review
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/group_skills/infra_dataops_group_skills/infra_aws_data_platform_review
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill infra-aws-data-platform-review

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you review and design an AWS-native data platform by covering the security, architecture, service trade-offs, and cost controls that commonly break production pipelines.

Core Features & Use Cases

  • S3 data lake architecture review: Validate lifecycle tiering (Bronze/Silver/Gold), encryption with KMS, public access blocking, and safe governance patterns.
  • IAM and access control auditing: Ensure least-privilege access for data pipelines using IRSA (service accounts) and Lake Formation for fine-grained row/column security.
  • Service selection and operational trade-offs: Compare EMR vs Glue ETL approaches, MWAA vs self-managed Airflow on EKS, and Redshift vs Athena for analytics workloads.
  • Streaming and orchestration guidance: Review MSK Kafka configuration (TLS, IAM auth, encryption at rest) and containerized pipeline execution with EKS networking and IRSA alignment.
  • Networking and cost optimization checklist: Confirm VPC endpoint strategy (S3/Glue), private subnet design, and practical savings via Intelligent-Tiering and Spot capacity.

Quick Start

Ask the AI: "Review our AWS data platform architecture and tell us what to change for S3 security, IAM least-privilege, MSK settings, Lake Formation controls, and the best ETL/analytics service choices."

Frequently Asked Questions about infra-aws-data-platform-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I review and harden my AWS data platform architecture for S3, IAM, and Lake Formation security?▼

Reviewing your AWS data platform involves validating S3 lifecycle tiering and KMS encryption, ensuring IAM least-privilege via IRSA, and applying Lake Formation for fine-grained row and column security to harden production pipelines.

What is the best way to choose between EMR and Glue for ETL pipelines on AWS?▼

Choosing between EMR and Glue for ETL depends on your operational trade-offs. EMR offers custom cluster control and Spot capacity savings, while Glue provides serverless scaling. Evaluate your specific batch processing needs to select the right tool.

How does MSK Kafka TLS and IAM authentication work with EKS IRSA networking?▼

MSK Kafka TLS and IAM authentication secures streaming workloads by mapping EKS service accounts to IAM roles via IRSA. This allows your EKS-hosted consumers and producers to securely connect to MSK brokers without managing static credentials.

When should I use Amazon Athena vs Redshift for analytics workloads?▼

Use Athena for serverless, on-demand S3 queries, and Redshift for complex, high-performance analytics requiring a dedicated data warehouse. Choosing between them depends on your query latency requirements and data volume.

What are common anti-patterns for VPC endpoint networking in an S3 data lake?▼

Common VPC endpoint anti-patterns include lacking S3 and Glue endpoints in private subnets, which causes traffic to traverse the public internet. Properly configuring VPC endpoints ensures secure, cost-optimized networking for your data lake.

Can I use MWAA instead of self-managed Airflow on EKS for pipeline orchestration?▼

Yes, you can use MWAA as a managed Airflow alternative to self-managed EKS deployments. MWAA reduces operational overhead, while EKS Airflow offers greater flexibility for custom dependencies and IRSA integration.

Related Skills

Explore More Software Engineering Skills→
awslabsawslabs
15

s3

Optimizes Amazon S3 bucket configuration, access control, and lifecycle policies for secure, cost-effective storage management.

Official
Advanced
abhijeetkakade1234abhijeetkakade1234
1

iam-privilege-escalation-audit

Audit cloud IAM policies for privilege escalation vectors across AWS, GCP, and Azure.

Community
Advanced
camoneartcamoneart
5

terraform-module-library

Create reusable Terraform modules for AWS, Azure, and GCP infrastructure.

Community
Intermediate
pluginagentmarketplacepluginagentmarketplace
5

cloud-platforms

Automate multi-cloud data platform design, deployment, and governance across AWS, GCP, and Azure.

Community
Intermediate