ggml-org/ggml

[Feature Request] rinna's Japanese GPT model support

Open

Aperta il 4 mar 2023

Vedi su GitHub
 (2 commenti) (1 reazione) (0 assegnatari)C++ (14.741 star) (1646 fork)auto 404
enhancementgood first issue

Descrizione

Thanks @ggerganov for your sharing.

I want to use GPT on my local pc. rinna Co.,Ltd is Japanese AI company. rinna provides some GPT models on huggingface. https://huggingface.co/rinna/japanese-gpt-1b https://huggingface.co/rinna/japanese-gpt2-xsmall https://huggingface.co/rinna/japanese-gpt2-small https://huggingface.co/rinna/japanese-gpt2-medium I'd like to use these models with ggml gpt. But, I can't convert these models for ggml. I think these models are pytorch bin model and tensorflow H5 weight.

Could you convert and support these models ?

Guida contributor

Tech stack
pythonpytorch
Dominio
machine learning
Tipo issue
feature
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
4
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
3-5 days
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
needs maintainer response
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
clear
Prerequisiti
PythonPyTorchGitModel conversion knowledge
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
25
Direzione di ricerca
Study the architecture of the listed rinna Japanese GPT models (1b, xsmall, small, medium) and understand the current ggml conversion tools (e.g., convert pt to ggml.py). Determine the differences from other supported GPT models and implement the necessary changes to support these models.