ggml-org/llama.cpp

ggml : add WebGPU backend

クローズ

#7,773 opened on 2024/06/05

 (28 件のコメント) (23 件のリアクション) (0 人の担当者)C++ (21,781 件のフォーク)batch import
help wantedresearch 🔬roadmap

Repository metrics

Stars
 (124,194 個のスター)
PR merge metrics
 (平均マージ 6d 8h) (30d で 389 merged PRs)

説明

I hope that this would be relatively easy to do since AFAIK WebGPU allows us to write kernels in a shader language, so we have experience how to create such backends.

There has been some initial work in https://github.com/ggerganov/ggml/pull/585 - could be useful as a starting point

コントリビューターガイド