skills.rest
LaurentPRAT-DB
LaurentPRAT-DBCOMMUNITY
Explore all skills by this author →
GitHub

performance-tuning

Analyze Databricks metrics and logs to tune Spark configuration and caching.

Updated Feb 27, 2026
Search Tags:#performance tuning#etl#workload analysis#databricks#spark optimization#data skew
One-click install
npx skills add https://github.com/LaurentPRAT-DB/LPT_claude_config --skill performance-tuning-laurentprat-db
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: performance-tuning
Source: https://github.com/LaurentPRAT-DB/LPT_claude_config/tree/main/skills/fe-vibe-export/fe-workflows/1.2.0/skills/performance-tuning
Command: npx skills add https://github.com/LaurentPRAT-DB/LPT_claude_config --skill performance-tuning-laurentprat-db

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill addresses the challenge of slow or inefficient Databricks workloads by providing a structured approach to performance optimization.

Core Features & Use Cases

  • Systematic Tuning: Guides users through a methodical process to identify and resolve performance bottlenecks.
  • Bottleneck Analysis: Helps pinpoint issues related to Spark configuration, data skew, I/O, and caching.
  • Use Case: A data engineer is experiencing long runtimes for a critical ETL job. This skill can be used to analyze the job's performance, identify the root cause of the slowness, and suggest specific optimizations to reduce execution time.

Quick Start

Use the performance-tuning skill to optimize the Databricks workload.

Frequently Asked Questions about performance-tuning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize Databricks workload performance for slow ETL jobs?▼

To optimize Databricks workload performance, this Skill analyzes job metrics and logs to identify bottlenecks related to Spark configuration, data skew, and I/O. It guides systematic tuning to reduce execution time for slow ETL jobs.

What is the best way to identify data skew and Spark configuration bottlenecks?▼

The best way to identify data skew and Spark configuration bottlenecks is through baseline analysis of workload metrics. This Skill pinpoints root causes of slowness and suggests specific caching and I/O optimization strategies.

How does systematic performance tuning improve Spark job execution time?▼

Systematic performance tuning improves Spark job execution time by establishing a baseline, identifying bottlenecks, and validating applied optimizations. It methodically resolves issues like data skew and inefficient caching strategies.

Can I use this approach to validate applied Spark optimizations on Databricks?▼

Yes, you can use this approach to validate applied Spark optimizations on Databricks. The Skill facilitates validation by analyzing workload metrics and logs before and after tuning to confirm reduced execution times.

When should I analyze caching strategies and I/O optimization for my workload?▼

You should analyze caching strategies and I/O optimization when experiencing long runtimes or inefficient workloads. This Skill helps pinpoint these specific bottlenecks through structured workload analysis and metrics evaluation.

Related Skills

Explore More Software Engineering Skills→
enigmaicon-engenigmaicon-eng
1

spark-engineer

Optimize Apache Spark DataFrame and SQL workloads to reduce shuffle overhead and handle skew.

Community
Advanced
leonardoteodorooleonardoteodoroo

spark-optimization

Optimizes Apache Spark workloads by tuning partitioning, caching, shuffle handling, memory, and adaptive execution for faster performance.

Community
Advanced
teradata-labsteradata-labs
7

monitor-resources

Monitor Teradata AMP processor load, CPU, memory, and I/O utilization in real-time.

Official
Advanced
nimadorostkarnimadorostkar
25

spark

Optimize Apache Spark pipelines by minimizing shuffles and mitigating data skew.

Community
Advanced