LuxDL/Lux.jl

Enzyme wrappers for AD utilities in Lux

Open

#738 创建于 2024年6月27日

在 GitHub 查看
 (0 评论) (1 反应) (0 负责人)Julia (700 star) (84 fork)batch import
enzymegood first issue

描述

Functions

  • batched_jacobian
    • Enzyme.Forward
    • Enzyme.Reverse
  • vector_jacobian_product
  • jacobian_vector_product

Nested Autodiff

Enzyme needs us to use autodiff_thunk for the internal call, so we can easily replace the call inside custom rrules.

  • EnzymeRules
  • CRC.rrule

贡献者指南

技术栈
无
领域
machine learningai
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
3-5 days
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
fresh
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
Familiarity with JuliaUnderstanding of Enzyme ADBasic knowledge of Lux.jl
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
35
研究方向
The issue requests implementing Enzyme wrappers for several AD utilities including batched jacobian, vector jacobian product, jacobian vector product, and handling nested autodiff via autodiff thunk. A contributor should study the existing Enzyme.jl package and Lux.jl's AD interface, then implement each function following the patterns in similar libraries. No linked PRs or comments are present; initial work can start by forking the repo and referencing the issue.
Enzyme wrappers for AD utilities in Lux · LuxDL/Lux.jl#738 | Good First Issue