sgl-project/sglang
[Feature] Profile the update weights from disk API of SGLang Diffusion
开放
#18,979 创建于 2026年2月18日
good first issue
仓库指标
- 星标
- (28,442 个星标)
- PR 合并指标
- (平均合并 2天 1小时) (30 天内合并 1,000 个 PR)
描述
Checklist
- If this is not a feature request but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
- Please use English. Otherwise, it will be closed.
Motivation
As we did in this comment:
https://github.com/sgl-project/sglang/pull/18306/#issuecomment-3898841774
We should profile the actual time breakdown in the update weights from disk.
Ideally speaking, 7B models' update should be within 1s (no considering save to disk time) in this https://github.com/zhaochenyang20/Awesome-ML-SYS-Tutorial/blob/main/sglang/latency-accelerate-for-weight-updates/readme.md
Related resources
No response