huggingface/lighteval

[EVAL] Add kyrgyzLLM benchmark

开放

#1,036 创建于 2025年11月4日

 (1 条评论) (0 个反应) (1 位负责人)Python (514 个派生)auto 404
good first issuenew-task

仓库指标

星标
 (2,496 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Hi,

We just open-sourced the Kyrgyz LLM Evaluation Dataset.

Evaluation short description

  • Why is this evaluation interesting?

KyrgyzLLM-Bench is the first comprehensive benchmark suite for deep language understanding in Kyrgyz. It is interesting because it provides broad, culturally grounded coverage by combining native benchmarks (such as KyrgyzMMLU and KyrgyzRC) with carefully translated and post-edited international benchmarks (such as HellaSwag, WinoGrande, BoolQ, GSM8K, and TruthfulQA).

  • How used is it in the community? As the benchmark was released recently, its adoption by the community is just beginning. It is significant because it's the first comprehensive benchmark suite for deep language understanding, specifically in the Kyrgyz language, providing a new and essential tool for researchers and developers.

Evaluation metadata

Thanks you!

贡献者指南