python-performance-optimization

What problem does it solve?

This Skill helps you identify and eliminate performance bottlenecks in Python applications, solving issues like slow execution times, high memory consumption, and inefficient data processing. It provides tools and patterns for CPU profiling, memory optimization, and leveraging advanced techniques like NumPy and multiprocessing, ensuring your applications run at peak efficiency.

Core Features & Use Cases

• Profiling Tools: Use cProfile, line_profiler, memory_profiler, and py-spy to pinpoint exact bottlenecks.
• Optimization Patterns: Learn efficient Python idioms for list comprehensions, string concatenation, dictionary lookups, and local variable access.
• Advanced Techniques: Leverage NumPy for numerical operations, lru_cache for memoization, and multiprocessing for CPU-bound tasks.
• Database & Memory Optimization: Implement batch operations, query optimization, and detect memory leaks.
• Use Case: Analyze a slow data processing script that takes hours to run, identify the CPU-intensive sections using cProfile, and then optimize them using NumPy for a significant speedup.

Quick Start

Example: Basic Timing Measurement

import time

def measure_time(): start = time.time() result = sum(range(1000000)) elapsed = time.time() - start print(f"Execution time: {elapsed:.4f} seconds") return result

measure_time()