good first issuehelp wantednew-task
Repository metrics
- Stars
- (2,496 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
Hello! We just released the benchmark for Turkic languages. Does it make sense if I add it to lighteval?
Evaluation short description
-
Why is this evaluation interesting? First native-language MMLU benchmark for low-resource Turkic languages.
-
How is it used in the community? Just released, MC high-school exam questions
Evaluation metadata
Provide all available
- Paper url: https://arxiv.org/abs/2502.11020
- Github url: https://github.com/ceferisbarov/TUMLU
- Dataset url: