good first issue
倉庫指標
- Star
- (28,442 star)
- PR 合併指標
- (平均合併 2天 1小時) (30 天內合併 1,000 個 PR)
描述
Checklist
- 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
- 2. Please use English, otherwise it will be closed.
Motivation
Hi,
I'd like to use the new abort_request API: https://github.com/sgl-project/sglang/blob/58f10679e1850fdc86046057c23bac5193156de9/python/sglang/srt/entrypoints/http_server.py#L549
However, I'm using multiple SGLang servers behind a router, and currently the router doesn't seem to support abort_request: https://github.com/sgl-project/sglang/blob/main/sgl-router/src/server.rs
I'm wondering if it makes sense to also support abort_request in the router. Thanks!
Related resources
No response