EnzymeAD/Enzyme.jl

API for Hessian

Open

#1,495 建立於 2024年6月6日

在 GitHub 查看
 (1 留言) (1 反應) (0 負責人)Julia (96 fork)batch import
good first issue

倉庫指標

Star
 (563 star)
PR 合併指標
 (平均合併 5天 1小時) (30 天內合併 76 個 PR)

描述

A hessian / hessian! function in Enzyme would be cool!

Right now the method described in https://enzymead.github.io/Enzyme.jl/stable/generated/autodiff/#Forward-over-reverse uses BatchDuplicated. Am I correct in assuming that, like ForwardDiff's "chunks", Enzyme's "batches" are limited in size by memory bandwitch, typically to the order of 10 elements? If so, should there be a Hessian mode that computes HVPs in batches smaller than the size n?

貢獻者指南