data-lake

Diagnose StarRocks external catalog query failures and stale data.

73|12|Updated Apr 24, 2026
One-click install
npx skills add https://github.com/StarRocks/starrocks-debug-skills --skill data-lake
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-lake
Source: https://github.com/StarRocks/starrocks-debug-skills/tree/main/data-lake
Command: npx skills add https://github.com/StarRocks/starrocks-debug-skills --skill data-lake

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill helps diagnose and resolve StarRocks external catalog problems where Hive, Iceberg, S3, HDFS, or Paimon queries fail, hang, or return stale data.

Core Features & Use Cases

  • Connectivity troubleshooting: Finds Hive Metastore reachability issues, startup blocking, and slow partition listing.
  • Authentication debugging: Identifies Kerberos failures such as expired tickets, clock skew, SPN mismatch, and missing JCE support.
  • Storage and network analysis: Investigates S3 rate limits, SSL problems, HDFS cache sizing, and network saturation on FE or BE nodes.
  • Freshness and cache tuning: Guides refresh actions and catalog property updates when external table data or partitions lag behind source changes.
  • Use Case: When a production dashboard suddenly shows old Hive partitions or all external table queries begin failing after a credential rotation, this Skill walks through log signals, validation checks, and targeted fixes to restore service.

Quick Start

Use the data-lake skill to investigate failing external catalog queries and stale external table data in a StarRocks cluster, then apply the recommended connectivity, authentication, cache, and network fixes.

Frequently Asked Questions about data-lake

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
Why do StarRocks external catalog queries fail after a Kerberos credential rotation?

StarRocks external catalog connectivity issues stem from Hive Metastore reachability problems, startup blocking, or slow partition listing. This Skill diagnoses these failures by analyzing log signals and network checks to restore query service.

How do I fix stale Hive partitions showing up in StarRocks external table queries?

To fix stale Hive partitions in StarRocks, you need to guide refresh actions and update catalog properties. This Skill helps tune metadata cache freshness for Hive, Iceberg, and Paimon workloads to sync external table data with source changes.

What is the best way to troubleshoot S3 rate limiting and HDFS access errors in StarRocks?

The best way to troubleshoot S3 rate limits and HDFS access errors is analyzing FE or BE node network saturation. This Skill investigates SSL problems and HDFS cache sizing to resolve storage access failures.

Does this troubleshooting approach work for both Iceberg and Paimon data lake integrations?

Yes, this troubleshooting approach works for Iceberg and Paimon data lake integrations. The Skill diagnoses external catalog query failures and metadata cache freshness issues across Hive, Iceberg, Paimon, and similar external table workloads.

How do I diagnose StarRocks external catalog outages using jstack and log analysis?

You diagnose StarRocks external catalog outages by performing jstack thread analysis and checking log signatures. This Skill walks through validation checks and catalog property tuning to identify connectivity, authentication, and network issues.