JuliaGPU/CUDA.jl

Add stream pool to avoid cuStreamCreate overhead

Open

#2,012 创建于 2023年7月29日

在 GitHub 查看
 (0 评论) (0 反应) (0 负责人)Julia (274 fork)batch import
enhancementgood first issueperformance

仓库指标

Star
 (1,408 star)
PR 合并指标
 (平均合并 5天 5小时) (30 天内合并 16 个 PR)

描述

Describe the bug

I tried adding multithreading to our code, and now we see occasional pauses due to CuStreamCreate:

Could be fixed by adding a Stream pool?

To reproduce

Available on request

Expected behavior

No pauses

Version info

Not sure exactly, I think it was Julia 1.8.5 with CUDA.jl 3.13.1 and CUDA 11.2.

Once our cluster upgrades the drivers, I can rerun with CUDA 12.

Additional context

cc @lcw

贡献者指南