ggml-org/llama.cpp

Study how LM Evaluation Harness works and try to implement it

Open

#231 opened on 2023年3月17日

GitHub で見る
 (10 comments) (9 reactions) (0 assignees)C++ (18,202 forks)batch import
enhancementgeneration qualityhelp wantedhigh priorityresearch 🔬

Repository metrics

Stars
 (110,169 stars)
PR merge metrics
 (平均マージ 6d 8h) (30d で 389 merged PRs)

説明

Update 10 Apr 2024: https://github.com/ggerganov/llama.cpp/issues/231#issuecomment-2047759312


It would be great to start doing this kind of quantitative analysis of ggml-based inference:

https://bellard.org/ts_server/

It looks like Fabrice evaluates the models using something called LM Evaluation Harness:

https://github.com/EleutherAI/lm-evaluation-harness

I have no idea what this is yet, but would be nice to study it and try to integrate it here and in other ggml-based projects. This will be very important step needed to estimate the quality of the generated output and see if we are on the right track.

コントリビューターガイド