triton-lang/triton

Dynmic indexing surpport?

Aperta

#707 aperta il 24 set 2022

 (5 commenti) (0 reazioni) (0 assegnatari)MLIR (3136 fork)github user discovery
help wanted

Metriche repository

Star
 (19.995 stelle)
Metriche merge PR
 (Merge medio 2g 18h) (185 PR mergiate in 30 g)

Descrizione

I wanna know if dynamic indexing is supported in triton. For, example, can I load a value tensor based on another index tensor instantiated at runtime like below?

indicies_ptr = index_ptr + pid_n * BLOCK_SIZE_N +  tl.arange(0, BLOCK_SIZE_N) 
indicies = tl.load(indicies_ptr)
indexed_values_ptr = value_ptr + indices
indexed_values = tl.load(indexed_values_ptr)

I've read all tutorials in the official docs, all loading is based on static indexing with tl.arange(). Before I try triton for my project, I just want to confirm if dynamic indexing is supported, this is important for my application.

Guida contributor