Apply latency hiding patterns to Python HPC workloads with CUDA streams.
npx skills add https://github.com/JoaquinCampo/Skills --skill hpc-python
Please help me install this Agent Skill. Skill: hpc-python Source: https://github.com/JoaquinCampo/Skills/tree/main/hpc-python Command: npx skills add https://github.com/JoaquinCampo/Skills --skill hpc-python
Python HPC patterns — threading/multiprocessing/async, CUDA streams, latency hiding, PyTorch DDP. Use when writing performance-sensitive Python code, distributed training, or parallel data processing.
Run a minimal latency-hiding example that overlaps data transfer with computation in a PyTorch training loop.
High-intent search queries and answers about installing and using this skill.
Latency hiding reduces idle time in Python HPC workloads by overlapping data transfer and computation. It uses threading, multiprocessing, asyncio, and CUDA streams to maximize hardware utilization in performance-sensitive distributed training.
CUDA streams enable compute and communication overlap by assigning data transfers and kernel executions to separate streams. Combined with PyTorch DDP, this allows concurrent operations that minimize synchronization bottlenecks in distributed training.
Yes, applying CUDA stream overlap and double buffering requires a CUDA-enabled GPU. Additionally, PyTorch is required to execute the distributed training scenarios and manage the careful synchronization needed to avoid deadlocks.
The best way to build scalable data pipelines is combining multiprocessing and asyncio for parallel data processing. These concurrency patterns allow overlapping CPU and GPU work, maximizing throughput for HPC workflows.
Deadlocks during stream synchronization occur when careful synchronization is mishandled across CUDA streams. Correctly managing double buffering and stream overlap is required to avoid blocking dependencies between concurrent compute and data transfer operations.
SciMate-AIAutomate CUDA toolchain setup, GPU-aware MPI, and scheduler integration for HPC workflows.
AesopScottCache verified handshake states and batch signature verification tasks.
LancerLabAnalyze NVIDIA Nsight Compute reports to classify GPU kernel bottlenecks.
copyleftdevBuild FPGA-based trading systems with Verilog, Python, and C++.
