sgl-project/sglang

[Task] Add priority scheduling CIs for preemption path

Chiusa

#13.470 aperta il 18 nov 2025

 (1 commento) (0 reazioni) (2 assegnatari)Python (6216 fork)auto 404
good first issue

Metriche repository

Star
 (28.442 stelle)
Metriche merge PR
 (Merge medio 2g 1h) (1000 PR mergiate in 30 g)

Descrizione

Checklist

Motivation

There is a number token and request level memory accounting issues reported and fixed by the community recently. It would be good to complement them with robust CI tests.

Context:

  1. https://github.com/sgl-project/sglang/pull/12494
  2. https://github.com/sgl-project/sglang/pull/13142
  3. https://github.com/sgl-project/sglang/pull/13201; https://github.com/sgl-project/sglang/issues/13111 (TestRemTotalTokenOffsetBug)
  4. https://github.com/sgl-project/sglang/blob/5ef728716b2c1159bbb7cd5c098e7720137354ce/python/sglang/srt/managers/schedule_policy.py#L666-L668 - cover this case

Related resources

No response

Guida contributor