sgl-project/sglang

[Feature] request for "classify" method for sglang router

クローズ

#15,240 opened on 2025/12/16

 (10 件のコメント) (0 件のリアクション) (0 人の担当者)Python (6,216 件のフォーク)auto 404
good first issue

Repository metrics

Stars
 (28,442 個のスター)
PR merge metrics
 (平均マージ 2d 1h) (30d で 1,000 merged PRs)

説明

Checklist

Motivation

In RL, we may launch a router to dispatch reward computation requests for both generative rewards (via /generate) and discriminative rewards (via /classify). I note that the "classify" api has not been implemented in sglang router (https://docs.sglang.io/advanced_features/router.html#api-surface). Hope future release will include this feat.

In addition to this, I want to report a bug that in the latest sglang router, the router fails to handle "v1/embeddings" requests after the servers sleep and then wake up.

# step 1: Launch multiple workers and one router
# step 2: Sleep servers and then wake up them
# step 3: Post "v1/embeddings" requests to router

For sglang-router==0.2.4 curl http://{router_address}/v1/models {"object":"list","data":[{"id":"unknown","object":"model","owned_by":"local"}]} and the reward computation also fails

For sglang-router==0.2.2 all behaviors are correct

@slin1237 @zhaochenyang20

Related resources

No response

コントリビューターガイド