good first issuehelp wantednew-task
倉庫指標
- 星標
- (2,496 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
Hello! We just released the benchmark for Turkic languages. Does it make sense if I add it to lighteval?
Evaluation short description
-
Why is this evaluation interesting? First native-language MMLU benchmark for low-resource Turkic languages.
-
How is it used in the community? Just released, MC high-school exam questions
Evaluation metadata
Provide all available
- Paper url: https://arxiv.org/abs/2502.11020
- Github url: https://github.com/ceferisbarov/TUMLU
- Dataset url: