help wanted
Repository metrics
- Stars
- (4,568 個のスター)
- PR merge metrics
- (平均マージ 5d 11h) (30d で 15 merged PRs)
説明
does koharu can't utilize shared gpu memory? because im using sugoi 14b ultra models and sometimes it just stop translating after dedicated memory is full
my system is using rtx 3060 12Gb vram intel core i5 10400f and 64Gb ram. so i have about 32gb shared memory
sugoi 14b ultra model is really nice at translating, thats why i like it even it is slower than vntl-llama3-8b-v2.