good first issuehigh priority
Repository metrics
- Stars
- (28,442 個のスター)
- PR merge metrics
- (平均マージ 2d 1h) (30d で 1,000 merged PRs)
説明
Now importing sglang takes too long. On my H100 machine, it took 12s to just import sglang. Can someone help reducing the importing time?
> time python -c "from sglang.srt.managers.scheduler import Scheduler"
All deep_gemm operations loaded successfully!
W0916 03:22:46.348000 152559 torch/utils/cpp_extension.py:2425] TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation.
W0916 03:22:46.348000 152559 torch/utils/cpp_extension.py:2425] If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'] to specific architectures.
real 0m12.310s
user 0m13.728s
sys 0m23.912s