triton-lang/triton

how to implement backward propagation

开放

#1,189 创建于 2023年2月13日

 (4 条评论) (0 个反应) (0 位负责人)MLIR (3,136 个派生)github user discovery
help wanted

仓库指标

星标
 (19,995 个星标)
PR 合并指标
 (平均合并 2天 18小时) (30 天内合并 185 个 PR)

描述

Hi. I am new to triton and cuda. From my understanding, when we implement a customized pytorch operator using cuda, we need to define both forward and backward function, so that the gradients are propagated properly. However, in the triton document (e.g., how to implement vector addition, fused softmax ...), there seems nothing about backward function? Does that mean the backward function is automatically generated by triton? Thx!

贡献者指南