sgl-project/sglang
[Feature] Simplify `tree_speculative_sampling_target_only`
開放
#12,562 建立於 2025年11月3日
good first issue
倉庫指標
- 星標
- (28,442 顆星)
- PR 合併指標
- (平均合併 1天 13小時) (30 天內合併 1,000 個 PR)
描述
Checklist
- 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
- 2. Please use English, otherwise it will be closed.
Motivation
Some TODOs for newcomers to SGLang
- Remove passing argument
draft_probs - Add a more efficient kernel (torch/triton/cuda) for topk=1 special case.
Related resources
No response