huggingface/lighteval

[BUG] custom model docs don't run: missing imports

Aperta

#760 aperta il 21 mag 2025

 (5 commenti) (0 reazioni) (0 assegnatari)Python (514 fork)auto 404
bugdocumentationgood first issue

Metriche repository

Star
 (2496 stelle)
Metriche merge PR
 (Metriche PR in attesa)

Descrizione

Describe the bug

https://github.com/huggingface/lighteval/blob/v0.9.2/docs/source/evaluating-a-custom-model.mdx#creating-a-custom-model did not import ParallelismManager.

https://github.com/huggingface/lighteval/blob/v0.9.2/docs/source/using-the-python-api.mdx uses a nonexistent EnvConfig

To Reproduce

N/a

Expected behavior

Docs to not have missing imports

Version info

lighteval==0.9.2

Guida contributor