JuliaParallel/Dagger.jl

Wrap inputs in Chunk only once, or not at all

Open

#200 ouverte le 28 janv. 2021

Voir sur GitHub
 (1 commentaire) (0 réactions) (0 assignés)Julia (86 forks)batch import
data movementhelp wantedperformance

Métriques du dépôt

Stars
 (706 stars)
Métriques de merge PR
 (Merge moyen 12j 5h) (4 PRs mergées en 30 j)

Description

In #199 I've fixed a "bug" where non-thunk inputs are serialized during the thunk RPC call, which is silly for large inputs. That fix assumes that inputs are large enough to wrap in a Chunk, which is not always true. It also re-wraps inputs in Chunks multiple times, which can incur extra overhead. We should make a dynamic decision whether to wrap in a Chunk, and if we wrap, wrap just once.

Guide contributeur