good first issuehelp wantednew-task
仓库指标
- 星标
- (2,496 个星标)
- PR 合并指标
- (PR 指标待抓取)
描述
Hello! We just released the benchmark for Turkic languages. Does it make sense if I add it to lighteval?
Evaluation short description
-
Why is this evaluation interesting? First native-language MMLU benchmark for low-resource Turkic languages.
-
How is it used in the community? Just released, MC high-school exam questions
Evaluation metadata
Provide all available
- Paper url: https://arxiv.org/abs/2502.11020
- Github url: https://github.com/ceferisbarov/TUMLU
- Dataset url: