unslothai/unsloth

[Docs Improvement] Improve documentation on how to export model from Colab

Fermée

#1 615 ouverte le 4 févr. 2025

 (9 commentaires) (1 réaction) (0 personne assignée)Python (5 658 forks)batch import
feature requestgood first issuehelp wanted

Métriques du dépôt

Stars
 (64 271 étoiles)
Métriques de merge PR
 (Métriques PR en attente)

Description

I followed the well documented and easy step to fine tune a Mistal model. It went well, I exported the model to Colab and created an Ollama model.

However, I would like to use this model locally on my machine.

I found some information on connecting to Google Drive, but on my side (tried several browsers) it fails with: MessageError: Error: credential propagation was unsuccessful

Of course the resulting unsloth.Q8_0.gguf is 7GB so direct download from Colab fails.

Are there any options ? It could be listed as a caveat in the docs maybe ?

Thanks !

Guide contributeur