huggingface/lighteval

[EVAL] Add kyrgyzLLM benchmark

オープン

#1,036 opened on 2025/11/04

 (1 件のコメント) (0 件のリアクション) (1 人の担当者)Python (514 件のフォーク)auto 404
good first issuenew-task

Repository metrics

Stars
 (2,496 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Hi,

We just open-sourced the Kyrgyz LLM Evaluation Dataset.

Evaluation short description

  • Why is this evaluation interesting?

KyrgyzLLM-Bench is the first comprehensive benchmark suite for deep language understanding in Kyrgyz. It is interesting because it provides broad, culturally grounded coverage by combining native benchmarks (such as KyrgyzMMLU and KyrgyzRC) with carefully translated and post-edited international benchmarks (such as HellaSwag, WinoGrande, BoolQ, GSM8K, and TruthfulQA).

  • How used is it in the community? As the benchmark was released recently, its adoption by the community is just beginning. It is significant because it's the first comprehensive benchmark suite for deep language understanding, specifically in the Kyrgyz language, providing a new and essential tool for researchers and developers.

Evaluation metadata

Thanks you!

コントリビューターガイド