huggingface/lighteval

[FT] Manage script and language in the Language enum

开放

#745 创建于 2025年5月19日

 (2 条评论) (0 个反应) (0 位负责人)Python (514 个派生)auto 404
featuregood first issue

仓库指标

星标
 (2,496 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Issue encountered

At the moment, we assume one single script per language (which is incorrect).

Solution/Feature

The Language enum needs to be updated to include the script, and templates need to be edited to select which script to provide among the alternatives. See the FLORES 200 task for an example where some subsets had to be removed for this reason.

贡献者指南