EnzymeAD/Enzyme.jl

API for Hessian

Open

#1,495 opened on 2024年6月6日

GitHub で見る
 (1 comment) (1 reaction) (0 assignees)Julia (96 forks)batch import
good first issue

Repository metrics

Stars
 (563 stars)
PR merge metrics
 (平均マージ 5d 1h) (30d で 76 merged PRs)

説明

A hessian / hessian! function in Enzyme would be cool!

Right now the method described in https://enzymead.github.io/Enzyme.jl/stable/generated/autodiff/#Forward-over-reverse uses BatchDuplicated. Am I correct in assuming that, like ForwardDiff's "chunks", Enzyme's "batches" are limited in size by memory bandwitch, typically to the order of 10 elements? If so, should there be a Hessian mode that computes HVPs in batches smaller than the size n?

コントリビューターガイド