huggingface/ratchet

Shared Array Buffer 🪄

オヌプン

#79 opened on 2024/02/13

 (0 件のコメント) (1 件のリアクション) (0 人の担圓者)Rust (44 件のフォヌク)auto 404
help wanted

Repository metrics

Stars
 (768 個のスタヌ)
PR merge metrics
 (PR metrics pending)

説明

When we pull the model from the wire, we should write it into a shared array buffer: https://rustwasm.github.io/wasm-bindgen/examples/raytrace.html

This will reduce memory usage, ideally peak memory usage should be ~model size. Loading will require some magic.

コントリビュヌタヌガむド