sgl-project/sglang

[Feature] Support encoder models for flash_infer backend

已关闭

#6,050 创建于 2025年5月6日

 (2 条评论) (1 个反应) (0 位负责人)Python (6,216 个派生)auto 404
good first issue

仓库指标

星标
 (28,442 个星标)
PR 合并指标
 (平均合并 2天 1小时) (30 天内合并 1,000 个 PR)

描述

Checklist

Motivation

          @DavidBao03 hi, currently only support encoder model with torch_native attn backend and triton attn backend. Other attn backend is not supported yet.

Originally posted by @woodx9 in https://github.com/sgl-project/sglang/issues/4887#issuecomment-2847365703

Related resources

No response

贡献者指南