JuliaParallel/Dagger.jl

Wrap inputs in Chunk only once, or not at all

Open

#200 aperta il 28 gen 2021

Vedi su GitHub
 (1 commento) (0 reazioni) (0 assegnatari)Julia (86 fork)batch import
data movementhelp wantedperformance

Metriche repository

Star
 (706 star)
Metriche merge PR
 (Merge medio 12g 5h) (4 PR mergiate in 30 g)

Descrizione

In #199 I've fixed a "bug" where non-thunk inputs are serialized during the thunk RPC call, which is silly for large inputs. That fix assumes that inputs are large enough to wrap in a Chunk, which is not always true. It also re-wraps inputs in Chunks multiple times, which can incur extra overhead. We should make a dynamic decision whether to wrap in a Chunk, and if we wrap, wrap just once.

Guida contributor