ggml-org/llama.cpp

ggml : add WebGPU backend

已關閉

#7,773 建立於 2024年6月5日

 (28 則留言) (23 個反應) (0 位負責人)C++ (21,825 個分叉)batch import
help wantedresearch 🔬roadmap

倉庫指標

星標
 (124,401 顆星)
PR 合併指標
 (平均合併 6天 8小時) (30 天內合併 389 個 PR)

描述

I hope that this would be relatively easy to do since AFAIK WebGPU allows us to write kernels in a shader language, so we have experience how to create such backends.

There has been some initial work in https://github.com/ggerganov/ggml/pull/585 - could be useful as a starting point

貢獻者指南