unslothai/unsloth

[Feature] Draft model / speculative decoding

クローズ

#4,753 opened on 2026/04/01

 (4 件のコメント) (2 件のリアクション) (0 人の担当者)Python (5,658 件のフォーク)batch import
feature requestgood first issuehelp wanted

Repository metrics

Stars
 (64,271 個のスター)
PR merge metrics
 (平均マージ 3d 15h) (30d で 525 merged PRs)

説明

Can we have the possibility to select draft model in ui? Seems like an important feature, I wonder how fast would Qwen3.5 27b be if I used Qwen3.5 0.8b as draft model.

コントリビューターガイド