huggingface/ratchet

Shared Array Buffer 🪄

开放

#79 创建于 2024年2月13日

 (0 条评论) (1 个反应) (0 位负责人)Rust (44 个派生)auto 404
help wanted

仓库指标

星标
 (768 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

When we pull the model from the wire, we should write it into a shared array buffer: https://rustwasm.github.io/wasm-bindgen/examples/raytrace.html

This will reduce memory usage, ideally peak memory usage should be ~model size. Loading will require some magic.

贡献者指南