Automate building and running Apache Spark batch and streaming data processing jobs.
npx skills add https://github.com/clawdata/clawdata --skill spark-clawdata
Please help me install this Agent Skill. Skill: spark Source: https://github.com/clawdata/clawdata/tree/main/skills/spark Command: npx skills add https://github.com/clawdata/clawdata --skill spark-clawdata
Build and run Apache Spark data processing jobs with clear guidance for submitting applications, starting interactive sessions, and querying data.
Start a local Spark session and run a sample job with spark-submit.
High-intent search queries and answers about installing and using this skill.
You can start PySpark and Spark SQL shells to perform interactive development, execute DataFrame transformations, and run ad-hoc queries on your datasets.
You can start PySpark and Spark SQL shells to perform interactive development, execute DataFrame transformations, and run ad-hoc queries on your datasets.
This Skill automates building and running Spark jobs, applying to batch and streaming workloads including DataFrame operations, Spark SQL, and cluster management.
This approach covers basic cluster management, ensuring smooth execution of batch and streaming workloads via spark-submit, pyspark, and spark-sql.
This allows you to validate Spark SQL queries and DataFrame operations before deploying to a larger cluster environment.
It provides typical configuration patterns for cluster management, supporting both batch and streaming workloads effectively.
microsoftRun interactive PySpark and Spark SQL queries on Fabric Lakehouse Livy sessions.
weirdgmeDesign and implement scalable platform engineering patterns for internal developer platforms.
stephanjOptimize Apache Spark applications for performance and pipeline architecture.
OpenLAIRProcess large-scale ML data with Ray Data for distributed preprocessing and ETL.
