JuliaParallel/Dagger.jl

Wrap inputs in Chunk only once, or not at all

Open

#200 geöffnet am 28. Jan. 2021

Auf GitHub ansehen
 (1 Kommentar) (0 Reaktionen) (0 zugewiesene Personen)Julia (86 Forks)batch import
data movementhelp wantedperformance

Repository-Metriken

Stars
 (706 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 12T 5h) (4 gemergte PRs in 30 T)

Beschreibung

In #199 I've fixed a "bug" where non-thunk inputs are serialized during the thunk RPC call, which is silly for large inputs. That fix assumes that inputs are large enough to wrap in a Chunk, which is not always true. It also re-wraps inputs in Chunks multiple times, which can incur extra overhead. We should make a dynamic decision whether to wrap in a Chunk, and if we wrap, wrap just once.

Contributor Guide