hpc-python

What problem does it solve?

Python HPC patterns — threading/multiprocessing/async, CUDA streams, latency hiding, PyTorch DDP. Use when writing performance-sensitive Python code, distributed training, or parallel data processing.

Core Features & Use Cases

• Overlap CPU and GPU work with threading, multiprocessing, asyncio, and CUDA streams.
• Implement latency hiding with double buffering, compute/communication overlap, and DDP optimizations.
• Build scalable data pipelines and HPC workflows for Python-based ML and scientific computing.

Quick Start

Run a minimal latency-hiding example that overlaps data transfer with computation in a PyTorch training loop.