Skills
.Work. You
Rest

spark-k8s

Community

Diagnose Spark jobs and tasks on Kubernetes with REST APIs.

Software Engineering#Kubernetes#REST API#Spark#performance analysis#job diagnostics
Authoryangyongyongyong
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill provides a comprehensive toolset for diagnosing Spark jobs and tasks on Kubernetes, allowing you to analyze job status, stages, executors, and more using REST APIs.

Core Features & Use Cases

  • Job Status and History: View job status, duration, and stage information.
  • Executor and Task Analysis: Inspect executor health, task performance, and skew.
  • Resource Utilization: Assess resource usage, such as input, output, and shuffle data.
  • SQL Execution: Analyze SQL execution metrics, including failures and plans.
  • Use Case: If you are facing performance issues with a Spark job running on Kubernetes, this Skill can help you identify bottlenecks such as slow stages, resource allocation, or executor failures.

Quick Start

Use the spark-k8s skill to list the applications in the Spark History Server.

Dependency Matrix

Required Modules

httpx

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: spark-k8s
Download link: https://github.com/yangyongyongyong/skills/archive/main.zip#spark-k8s

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.