abetlen/llama-cpp-python

Add Finetune Support

Open

#814 opened on 2023年10月11日

GitHub で見る
 (3 comments) (8 reactions) (0 assignees)Python (644 forks)batch import
enhancementhelp wanted

Repository metrics

Stars
 (4,995 stars)
PR merge metrics
 (平均マージ 1d 5h) (30d で 68 merged PRs)

説明

In the late versions of llama.cpp there are ways to fine-tune the model using LoRA adapters: https://github.com/ggerganov/llama.cpp/pull/2632

However, either I missed it or are there no functions introduced in this PR imported into this project?

Describe alternatives you've considered Sure it's always an option to use a CLI tool, but I guess Python binding can be useful.

コントリビューターガイド