huggingface/lighteval
[FT] Manage script and language in the Language enum
オープン
#745 opened on 2025/05/19
featuregood first issue
Repository metrics
- Stars
- (2,496 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
Issue encountered
At the moment, we assume one single script per language (which is incorrect).
Solution/Feature
The Language enum needs to be updated to include the script, and templates need to be edited to select which script to provide among the alternatives. See the FLORES 200 task for an example where some subsets had to be removed for this reason.