aws-lakehouse

Community

Optimize your AWS lakehouse with S3 Tables, Iceberg, and Athena

AuthorTeiNam
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill helps users to build and query S3-based lakehouses using Apache Iceberg and Athena, addressing the challenges of data storage, query performance, and cost management on AWS.

Core Features & Use Cases

  • S3-based Lakehouse Construction: Provides guidance on using S3 Tables for managed storage and self-managed Iceberg for more control.
  • Querying with Athena: Shows how to use Athena for querying Iceberg tables, including performance considerations and compatibility with Iceberg V3.
  • Spark Processing: Offers tips on using Spark with EMR for complex data transformations.
  • Performance Tuning: Covers strategies for optimizing Spark performance, including the use of vectorized accelerators like Comet and Gluten.
  • Use Case: For a company using AWS and needing to analyze large datasets stored on S3, this Skill would help them to choose the right storage and query options for their lakehouse.

Quick Start

To activate the skill for querying your S3-based Iceberg table with Athena, run: 'query_iceberg_table'.

Dependency Matrix

Required Modules

None required

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: aws-lakehouse
Download link: https://github.com/TeiNam/kiro-with-harness/archive/main.zip#aws-lakehouse

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.