unslothai/unsloth

Add support for LISA ?

Open

#285 opened on 2024年3月28日

GitHub で見る
 (4 comments) (0 reactions) (0 assignees)Python (5,658 forks)batch import
feature requesthelp wanted

Repository metrics

Stars
 (64,271 stars)
PR merge metrics
 (平均マージ 3d 15h) (30d で 525 merged PRs)

説明

Hello any plans to support with LISA ?

Arxiv: https://arxiv.org/pdf/2403.17919.pdf

how it compares in the terms of VRAM usage ? standard 16 bit model fine tuning ?

コントリビューターガイド