JuliaParallel/Dagger.jl

Wrap inputs in Chunk only once, or not at all

Open

#200 opened on 2021年1月28日

GitHub で見る
 (1 comment) (0 reactions) (0 assignees)Julia (86 forks)batch import
data movementhelp wantedperformance

Repository metrics

Stars
 (706 stars)
PR merge metrics
 (平均マージ 12d 5h) (30d で 4 merged PRs)

説明

In #199 I've fixed a "bug" where non-thunk inputs are serialized during the thunk RPC call, which is silly for large inputs. That fix assumes that inputs are large enough to wrap in a Chunk, which is not always true. It also re-wraps inputs in Chunks multiple times, which can incur extra overhead. We should make a dynamic decision whether to wrap in a Chunk, and if we wrap, wrap just once.

コントリビューターガイド