sgl-project/sglang
[Task] Add priority scheduling CIs for preemption path
クローズ
#13,470 opened on 2025/11/18
good first issue
Repository metrics
- Stars
- (28,442 個のスター)
- PR merge metrics
- (平均マージ 2d 1h) (30d で 1,000 merged PRs)
説明
Checklist
- If this is not a feature request but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
- Please use English. Otherwise, it will be closed.
Motivation
There is a number token and request level memory accounting issues reported and fixed by the community recently. It would be good to complement them with robust CI tests.
Context:
- https://github.com/sgl-project/sglang/pull/12494
- https://github.com/sgl-project/sglang/pull/13142
- https://github.com/sgl-project/sglang/pull/13201; https://github.com/sgl-project/sglang/issues/13111 (TestRemTotalTokenOffsetBug)
- https://github.com/sgl-project/sglang/blob/5ef728716b2c1159bbb7cd5c098e7720137354ce/python/sglang/srt/managers/schedule_policy.py#L666-L668 - cover this case
Related resources
No response