JuliaGPU/CUDA.jl

Add stream pool to avoid cuStreamCreate overhead

Open

#2,012 建立於 2023年7月29日

在 GitHub 查看
 (0 留言) (0 反應) (0 負責人)Julia (274 fork)batch import
enhancementgood first issueperformance

倉庫指標

Star
 (1,408 star)
PR 合併指標
 (平均合併 5天 5小時) (30 天內合併 16 個 PR)

描述

Describe the bug

I tried adding multithreading to our code, and now we see occasional pauses due to CuStreamCreate:

Could be fixed by adding a Stream pool?

To reproduce

Available on request

Expected behavior

No pauses

Version info

Not sure exactly, I think it was Julia 1.8.5 with CUDA.jl 3.13.1 and CUDA 11.2.

Once our cluster upgrades the drivers, I can rerun with CUDA 12.

Additional context

cc @lcw

貢獻者指南