good first issuehigh priority
仓库指标
- 星标
- (28,442 个星标)
- PR 合并指标
- (平均合并 2天 1小时) (30 天内合并 1,000 个 PR)
描述
Now importing sglang takes too long. On my H100 machine, it took 12s to just import sglang. Can someone help reducing the importing time?
> time python -c "from sglang.srt.managers.scheduler import Scheduler"
All deep_gemm operations loaded successfully!
W0916 03:22:46.348000 152559 torch/utils/cpp_extension.py:2425] TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation.
W0916 03:22:46.348000 152559 torch/utils/cpp_extension.py:2425] If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'] to specific architectures.
real 0m12.310s
user 0m13.728s
sys 0m23.912s