huggingface/lighteval

[FT] Manage script and language in the Language enum

開放

#745 建立於 2025年5月19日

 (2 則留言) (0 個反應) (0 位負責人)Python (514 個分叉)auto 404
featuregood first issue

倉庫指標

星標
 (2,496 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

Issue encountered

At the moment, we assume one single script per language (which is incorrect).

Solution/Feature

The Language enum needs to be updated to include the script, and templates need to be edited to select which script to provide among the alternatives. See the FLORES 200 task for an example where some subsets had to be removed for this reason.

貢獻者指南