EnzymeAD/Reactant.jl

Experiment with `Core.Memory` address space

Open

#181 aperta il 16 ott 2024

Vedi su GitHub
 (0 commenti) (1 reazione) (0 assegnatari)Julia (64 fork)github user discovery
help wanted

Metriche repository

Star
 (336 star)
Metriche merge PR
 (Merge medio 2g 10h) (36 PR mergiate in 30 g)

Descrizione

Julia 1.11 introduced Core.Memory and made Array a purely Julia type, which is nice for different optimization reasons. The interesting part for us is that GenericMemory has a parameter for kind and another for addrspace, which could potentially be exploited by us to store the memory managed by XLA. This means that ConcreteRArrays could be managed by a simple Array instead, with the address space managed by Reactant.

Docs say the following:

addrspace can currently only be set to Core.CPU. It is designed to permit extension by other systems such as GPUs, which might define values such as:

module CUDA
const Generic = bitcast(Core.AddrSpace{CUDA}, 0)
const Global = bitcast(Core.AddrSpace{CUDA}, 1)
end

The exact semantics of these other addrspaces is defined by the specific backend, but will error if the user is attempting to access these on the CPU.

A lot of info is missing on how to customize this behavior but we should keep an eye on it.

Guida contributor