FluxML/Zygote.jl

Unable to differentiate a broadcasted constructor with CUDA array inputs

Open

#1,528 创建于 2024年10月3日

在 GitHub 查看
 (2 评论) (0 反应) (0 负责人)Julia (1,568 star) (220 fork)batch import
CUDAhelp wanted

描述

Due to a CUDA bug: https://github.com/JuliaGPU/CUDA.jl/issues/2514, crossposted for reference.

Encountered when differentiating over:

using Distributions
using CUDA
a = cu(ones(5)); b = cu(zeros(5));

Normal.(a, b)

贡献者指南

技术栈
无
领域
machine learning
议题类型
bug
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
4
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
3-5 days
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
blocked
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
Julia basicsZygote.jl basicsCUDA.jl basicsBroadcasting in Julia
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
20
研究方向
The issue is blocked by a CUDA.jl bug (reference: JuliaGPU/CUDA.jl#2514). To proceed, first understand that bug and its implications on Zygote's differentiation of broadcasted constructors. Then, examine Zygote's handling of broadcasted calls and see if a workaround is possible. The provided example uses Distributions.Normal with CUDA arrays; review the interaction between Distributions and Zygote. No linked PRs or assignees exist yet.
Unable to differentiate a broadcasted constructor with CUDA array inputs · FluxML/Zygote.jl#1528 | Good First Issue