ggml-org/llama.cpp

ggml : add WebGPU backend

Closed

#7,773 建立於 2024年6月5日

在 GitHub 查看
 (28 留言) (23 反應) (0 負責人)C++ (110,169 star) (18,202 fork)batch import
help wantedresearch 🔬roadmap

描述

I hope that this would be relatively easy to do since AFAIK WebGPU allows us to write kernels in a shader language, so we have experience how to create such backends.

There has been some initial work in https://github.com/ggerganov/ggml/pull/585 - could be useful as a starting point

貢獻者指南

ggml : add WebGPU backend · ggml-org/llama.cpp#7773 | Good First Issue