LuxDL/Lux.jl

Enzyme wrappers for AD utilities in Lux

Open

#738 建立於 2024年6月27日

在 GitHub 查看
 (0 留言) (1 反應) (0 負責人)Julia (700 star) (84 fork)batch import
enzymegood first issue

描述

Functions

  • batched_jacobian
    • Enzyme.Forward
    • Enzyme.Reverse
  • vector_jacobian_product
  • jacobian_vector_product

Nested Autodiff

Enzyme needs us to use autodiff_thunk for the internal call, so we can easily replace the call inside custom rrules.

  • EnzymeRules
  • CRC.rrule

貢獻者指南

技術棧
無
領域
machine learningai
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
3-5 days
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
fresh
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
Familiarity with JuliaUnderstanding of Enzyme ADBasic knowledge of Lux.jl
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
35
研究方向
The issue requests implementing Enzyme wrappers for several AD utilities including batched jacobian, vector jacobian product, jacobian vector product, and handling nested autodiff via autodiff thunk. A contributor should study the existing Enzyme.jl package and Lux.jl's AD interface, then implement each function following the patterns in similar libraries. No linked PRs or comments are present; initial work can start by forking the repo and referencing the issue.
Enzyme wrappers for AD utilities in Lux · LuxDL/Lux.jl#738 | Good First Issue