EnzymeAD/Enzyme.jl

API for Hessian

开放

#1,495 创建于 2024年6月6日

 (3 条评论) (1 个反应) (0 位负责人)Julia (96 个派生)batch import
good first issue

仓库指标

星标
 (563 个星标)
PR 合并指标
 (平均合并 5天 1小时) (30 天内合并 76 个 PR)

描述

A hessian / hessian! function in Enzyme would be cool!

Right now the method described in https://enzymead.github.io/Enzyme.jl/stable/generated/autodiff/#Forward-over-reverse uses BatchDuplicated. Am I correct in assuming that, like ForwardDiff's "chunks", Enzyme's "batches" are limited in size by memory bandwitch, typically to the order of 10 elements? If so, should there be a Hessian mode that computes HVPs in batches smaller than the size n?

贡献者指南