cudamemcpy-tuner: cudaMemcpying up to 5x faster on a B300

· Henry Zhu · Nov. 15, 2026, 7:40 a.m.
Summary
The blog post discusses a tool called cudamemcpy-tuner, which can accelerate memory transfers between CPU and GPU by up to 5x without changing the original application. The author shares insights about optimizing pageable memory transfers, the impact of using pinned memory, and the benchmark results on various hardware setups, particularly focusing on datacenter workload improvements and potential cost savings.