huggingface/lighteval

[EVAL]: Add more African Benchmarks

开放

#373 创建于 2024年10月24日

 (4 条评论) (0 个反应) (0 位负责人)Python (514 个派生)auto 404
good first issuehelp wantednew-task

仓库指标

星标
 (2,496 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Evaluation short description

  • Why is this evaluation interesting? This focuses on 16 African languages, evaluated on three knowledge QA and reasoning tasks such as AfriMMLU, AfriMGSM and AfriXNLI, human translated from MMLU, MGSM and XNLI respectively.

  • How used is it in the community?

Evaluation metadata: IrokoBench

Provide all available

Evaluation metadata: Uhura

Provide all available

Evaluation metadata: SIB-200

Provide all available

@NathanHB

贡献者指南