python-performance-patterns

Speed up Python code by applying validated optimization patterns including NumPy vectorization for array operations, @lru_cache for repeated metadata checks, and safe parallel I/O patterns. These techniques reduce processing time from hours to minutes on large workloads while maintaining code correctness and safety.

Use @lru_cache to cache file type checks and metadata lookups, eliminating redundant I/O operations across repeated function calls. This pattern is especially effective when processing hundreds of files, reducing overhead while preserving immutability and correctness.

Yes. NumPy vectorization replaces slow Python loops with efficient compiled array operations, delivering significant speedups for numerical and image processing tasks. The Skill applies vectorization alongside caching and parallel patterns for safe, high-impact optimization across Python 3.10+ codebases.

Implement safe parallel I/O patterns that avoid common concurrency pitfalls while processing multiple files simultaneously. The Skill uses single-pass directory scanning with explicit filtering to preserve correctness and prevent data corruption during parallel operations.

Caching eliminates redundant I/O and function calls; vectorization replaces slow loops with compiled array operations. Together these patterns address file I/O overhead, repeated computations, and inefficient array processing—the most common bottlenecks in Python data processing and image handling workflows.

Yes. The Skill enforces immutability of cached metadata, uses validated NumPy operations, and applies safe parallel patterns to preserve functional correctness. All optimizations are low-risk and validated to maintain existing behavior while delivering 3-10x speed improvements.