good first issuehigh priority
倉庫指標
- 星標
- (28,442 顆星)
- PR 合併指標
- (平均合併 1天 13小時) (30 天內合併 1,000 個 PR)
描述
Now importing sglang takes too long. On my H100 machine, it took 12s to just import sglang. Can someone help reducing the importing time?
> time python -c "from sglang.srt.managers.scheduler import Scheduler"
All deep_gemm operations loaded successfully!
W0916 03:22:46.348000 152559 torch/utils/cpp_extension.py:2425] TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation.
W0916 03:22:46.348000 152559 torch/utils/cpp_extension.py:2425] If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'] to specific architectures.
real 0m12.310s
user 0m13.728s
sys 0m23.912s