huggingface/lighteval

[EVAL]: Add more African Benchmarks

開放

#373 建立於 2024年10月24日

 (4 則留言) (0 個反應) (0 位負責人)Python (514 個分叉)auto 404
good first issuehelp wantednew-task

倉庫指標

星標
 (2,496 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

Evaluation short description

  • Why is this evaluation interesting? This focuses on 16 African languages, evaluated on three knowledge QA and reasoning tasks such as AfriMMLU, AfriMGSM and AfriXNLI, human translated from MMLU, MGSM and XNLI respectively.

  • How used is it in the community?

Evaluation metadata: IrokoBench

Provide all available

Evaluation metadata: Uhura

Provide all available

Evaluation metadata: SIB-200

Provide all available

@NathanHB

貢獻者指南