finding-data-lake-assets

Resolve data lake asset references into Glue, S3, S3 Tables, and Redshift catalog entries.

Updated May 12, 2026
One-click install
npx skills add https://github.com/mreferre/aws-agent-toolkit-skills --skill finding-data-lake-assets
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: finding-data-lake-assets
Source: https://github.com/mreferre/aws-agent-toolkit-skills/tree/main/.kiro/skills/finding-data-lake-assets
Command: npx skills add https://github.com/mreferre/aws-agent-toolkit-skills --skill finding-data-lake-assets

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill resolves ambiguous data lake or lakehouse asset references into concrete Glue, S3, S3 Tables, and Redshift catalog entries so you can quickly identify the right dataset and where it lives.

Core Features & Use Cases

  • Guided asset resolution: Turns a table name, keyword, column name, or S3 path into a specific table reference with format and location where available.
  • Layered discovery with early stopping: Searches Glue first for high-confidence matches, then uses S3 reverse lookup or Redshift only when appropriate to minimize latency and token usage.
  • Confidence-gated disambiguation: Returns immediately on high confidence, lists top candidates for medium confidence, and reports what was searched or skipped when results are weak or absent.

Use case example: You say “what is our customer_id dataset in us-east-1?” and the Skill finds the best matching Glue table (or S3/S3 Tables/Redshift counterpart when relevant) and returns the resolved reference plus the sources searched/skipped.

Quick Start

Ask: "Resolve customer_id data in us-east-1 and tell me the matching Glue/S3/S3 Tables/Redshift table reference and location."

Frequently Asked Questions about finding-data-lake-assets

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find the specific Glue table or S3 path for a dataset using just a column name?

You can resolve ambiguous data lake assets by providing a table name, keyword, column name, or S3 path. The Skill searches the Glue Data Catalog first, then uses S3 reverse lookup or Redshift if needed, stopping early on the first high-confidence match to return the concrete table reference and location.

What is the best way to resolve a data lake table reference across multiple AWS catalog sources?

Resolving data lake table references is handled by searching Glue Data Catalog, S3, S3 Tables, and Redshift in a layered sequence. It returns the resolved table reference with format and location, while always reporting both the sources searched and the sources skipped.

Can I use an S3 path to look up the corresponding Glue Data Catalog table?

Yes, you can provide an S3 path to perform a reverse lookup. The Skill checks the Glue Data Catalog first for high-confidence matches and uses S3 reverse lookup when appropriate to identify the underlying table reference.

Do I need to specify an AWS region to resolve lakehouse assets?

Yes, an AWS region is required for resolution. The Skill automatically prompts you for the missing AWS region before proceeding with the metadata lookup across Glue, S3, S3 Tables, and Redshift.

What happens when a data lake asset search returns weak or ambiguous results?

When data lake asset searches yield weak or absent results, the Skill employs confidence-gated disambiguation. It lists the top candidate matches for medium confidence and transparently reports all sources searched and skipped, ensuring you know what was checked.

How does resolving data lake tables with this approach reduce latency and token usage?

Resolving data lake tables uses layered discovery with early stopping to minimize latency and token usage. It searches Glue first for high-confidence matches and only queries S3 reverse lookup or Redshift when appropriate, avoiding unnecessary catalog scans.