unslothai/unsloth

[Docs Improvement] Improve documentation on how to export model from Colab

Chiusa

#1615 aperta il 4 feb 2025

 (9 commenti) (1 reazione) (0 assegnatari)Python (5658 fork)batch import
feature requestgood first issuehelp wanted

Metriche repository

Star
 (64.271 stelle)
Metriche merge PR
 (Merge medio 3g 15h) (525 PR mergiate in 30 g)

Descrizione

I followed the well documented and easy step to fine tune a Mistal model. It went well, I exported the model to Colab and created an Ollama model.

However, I would like to use this model locally on my machine.

I found some information on connecting to Google Drive, but on my side (tried several browsers) it fails with: MessageError: Error: credential propagation was unsuccessful

Of course the resulting unsloth.Q8_0.gguf is 7GB so direct download from Colab fails.

Are there any options ? It could be listed as a caveat in the docs maybe ?

Thanks !

Guida contributor