huggingface/lighteval

[FT] LiteLLM concurrency parameters hard-coded

開放

#567 建立於 2025年2月16日

 (1 則留言) (0 個反應) (0 位負責人)Python (514 個分叉)auto 404
featuregood first issuehelp wanted

倉庫指標

星標
 (2,496 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

I noticed that for LiteLLM the concurrency is hard-coded for an arbitrary number (20). Well, a lot of the request behavior is hard coded, but the concurrency is the one that is probably least likely to work well as a one size fits all.

If everything is going through the YAML file, maybe it can be expanded, although the YAML file is another ball of wax (makes automated runs much harder when you can't just pass in parameters via a call)

貢獻者指南