gcp-spark
OfficialRun Spark on GCP Dataproc with ease.
Authorgemini-cli-extensions
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Coordinate Spark workloads on Google Cloud Dataproc and Serverless, enabling data engineers to deploy and manage scalable Spark jobs with reliable workflows.
Core Features & Use Cases
- Spark job orchestration on Dataproc Clusters and Serverless environments
- Read and write data using BigLake Iceberg catalogs, BigQuery and Spanner
- Debug and optimize Spark executions across pipelines, ML training/inference, and interactive sessions
Quick Start
Open a Spark notebook and run the workflow to read data from BigQuery, process with Spark on Dataproc, and write results to Iceberg.
Dependency Matrix
Required Modules
None requiredComponents
references
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: gcp-spark Download link: https://github.com/gemini-cli-extensions/data-agent-kit-starter-pack/archive/main.zip#gcp-spark Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.