gke-batch-hpc
CommunityRun GKE batch and HPC workloads with job queues.
Authorwangx7
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill eliminates the manual effort and high risk of errors associated with configuring and scaling batch processing and high-performance computing (HPC) workloads on GKE, which is critical for handling large parallel jobs, scientific simulations, and distributed training tasks.
Core Features & Use Cases
- Batch Job Orchestration: Run Kubernetes Jobs, JobSets for complex multi-job workflows, and Kueue for centralized job queuing and fair resource allocation across teams.
- HPC Workload Support: Configure low-latency compact node placement for tightly-coupled workloads and deploy MPI-based HPC applications via the Kubeflow MPI Operator.
- Cost Optimization: Reduce costs for interruptible batch workloads using Spot VMs with fallback patterns and scale-to-zero node pools that automatically shut down when no jobs are running.
- Real-World Use Case: A data engineering team can use this Skill to set up a queued system for 1000+ daily data processing jobs that automatically scales GKE resources up and down based on queue demand.
Quick Start
Use the gke-batch-hpc skill to configure a Kueue job queue and deploy a batch data processing workload on your existing GKE cluster.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: gke-batch-hpc Download link: https://github.com/wangx7/skills-collection/archive/main.zip#gke-batch-hpc Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 537,000+ vetted skills library on demand.