ggml-org/llama.cpp

feature request - disabling tokenizer in conversion / inference

クローズ

#1,765 opened on 2023/06/08

 (7 件のコメント) (1 件のリアクション) (0 人の担当者)C++ (21,764 件のフォーク)batch import
enhancementgood first issuehelp wanted

Repository metrics

Stars
 (124,134 個のスター)
PR merge metrics
 (平均マージ 6d 8h) (30d で 389 merged PRs)

説明

in #1764 i asked if it'd be possible to add a Huggingface tokenizer. but - HF tokenizers are quite flexible and officially supporting them in llama.cpp (or ggml?) might be a lot of hassle.

a much easier workaround would be allowing to disable tokenizers in both model conversion and inference. this means the users are supposed to encode(text)/decode(ids) in their implementation for using llama.cpp. in my case, for example, i'll use a python GUI and a wrapper anyway.

i'd like to work on it, but honestly i don't think i understand enough to be able to do this. i'd appreciate very much if anyone's interested in it.

コントリビューターガイド