huggingface/lighteval

[BUG] custom model docs don't run: missing imports

Offen

#760 geöffnet am 21.05.2025

 (5 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Python (514 Forks)auto 404
bugdocumentationgood first issue

Repository-Metriken

Stars
 (2.496 Sterne)
PR-Merge-Metriken
 (PR-Metriken ausstehend)

Beschreibung

Describe the bug

https://github.com/huggingface/lighteval/blob/v0.9.2/docs/source/evaluating-a-custom-model.mdx#creating-a-custom-model did not import ParallelismManager.

https://github.com/huggingface/lighteval/blob/v0.9.2/docs/source/using-the-python-api.mdx uses a nonexistent EnvConfig

To Reproduce

N/a

Expected behavior

Docs to not have missing imports

Version info

lighteval==0.9.2

Contributor Guide