good first issuehelp wantednew-task
倉庫指標
- 星標
- (2,496 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
Evaluation short description
-
Why is this evaluation interesting? This focuses on 16 African languages, evaluated on three knowledge QA and reasoning tasks such as AfriMMLU, AfriMGSM and AfriXNLI, human translated from MMLU, MGSM and XNLI respectively.
-
How used is it in the community?
Evaluation metadata: IrokoBench
Provide all available
- Paper url: https://arxiv.org/abs/2406.03368
- Github url:
- Dataset url: https://huggingface.co/collections/masakhane/irokobench-665a21b6d4714ed3f81af3b1
Evaluation metadata: Uhura
Provide all available
- Paper url:
- Github url:
- Dataset url: https://huggingface.co/datasets/ebayes/uhura-arc-easy-clean , https://huggingface.co/datasets/ebayes/uhura-truthfulqa-clean
Evaluation metadata: SIB-200
Provide all available
- Paper url: https://aclanthology.org/2024.eacl-long.14/
- Github url: https://github.com/dadelani/sib-200
- Dataset url: https://huggingface.co/datasets/Davlan/sib200
@NathanHB