JuliaParallel/Dagger.jl

Wrap inputs in Chunk only once, or not at all

Open

#200 建立於 2021年1月28日

在 GitHub 查看
 (1 留言) (0 反應) (0 負責人)Julia (86 fork)batch import
data movementhelp wantedperformance

倉庫指標

Star
 (706 star)
PR 合併指標
 (平均合併 12天 5小時) (30 天內合併 4 個 PR)

描述

In #199 I've fixed a "bug" where non-thunk inputs are serialized during the thunk RPC call, which is silly for large inputs. That fix assumes that inputs are large enough to wrap in a Chunk, which is not always true. It also re-wraps inputs in Chunks multiple times, which can incur extra overhead. We should make a dynamic decision whether to wrap in a Chunk, and if we wrap, wrap just once.

貢獻者指南