unslothai/unsloth

[Bug] Multi-gpu finetuning in Unsloth

開放

#3,248 建立於 2025年9月1日

 (2 則留言) (0 個反應) (0 位負責人)Python (5,658 個分叉)batch import
help wantedmultigpu

倉庫指標

星標
 (64,271 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

  1. Did you update? pip install --upgrade unsloth unsloth_zoo -->yes
  2. Colab or Kaggle or local / cloud -->cloud
  3. Number GPUs used, use nvidia-smi --?> 4
  4. Which notebook? Please link!
  5. Which Unsloth version, TRL version, transformers version, PyTorch version?
  6. Which trainer? SFTTrainer, GRPOTrainer etc --> SFTTrainer
Put Minimal code to reproduce error here ###Remove Hugging Face token###

🦥 You can also ask via our Reddit page: https://www.reddit.com/r/unsloth/

I am able to finetuned Gemma 3 4B model using unsloth in one gpu it is working fine, but when I am trying to use it in multi-gpu settings, I am not able to use it properly. Any help regarding multi-gpu support will be appriciate. Please help to set up multi-gpu finetuning through unsloth. Thanks

貢獻者指南