sgl-project/sglang

[Feature] Create benchmark and dataset usage scripts for embedding models

Open

#9,674 创建于 2025年8月27日

在 GitHub 查看
 (6 评论) (0 反应) (0 负责人)Python (6,216 fork)auto 404
good first issuehelp wanted

仓库指标

Star
 (28,442 star)
PR 合并指标
 (平均合并 2天 1小时) (30 天内合并 1,000 个 PR)

描述

Look at the following for related tests, and the benchmark script should be similar to bench_serving Existing Tests:

models/test_embedding_models.py — Backend, 73s — PR: core embedding model implementations (covers srt/models/*_embedding.py, srt/entrypoints/openai/serving_embedding.py).

models/test_encoder_embedding_models.py — Backend, 100s — Post-merge: encoder-based embedding models (BERT/Roberta-style).

models/test_cross_encoder_models.py — Backend, 100s — Post-merge: cross-encoder/reranker models (related to embedding-based tasks but a different architecture).

openai_server/basic/test_serving_embedding.py — Frontend/unit, 10s — Run on all PRs: embedding serving layer (validates the serving path).

openai_server/basic/test_openai_embedding.py — Frontend, 141s — Frontend (PR/post-merge as listed): end-to-end OpenAI embedding API endpoints.

test_input_embeddings.py — Backend, 38s — Post-merge: tests the input embedding handling/path.

贡献者指南