EnzymeAD/Reactant.jl

Missing neural network operations

Open

#250 geöffnet am 9. Nov. 2024

Auf GitHub ansehen
 (0 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Julia (64 Forks)github user discovery
good first issue

Repository-Metriken

Stars
 (336 Stars)
PR-Merge-Metriken
 (PR-Metriken ausstehend)

Beschreibung

NNlib

  • activations
    • tanh_fast
    • sigmoid
    • sigmoid_fast
  • softmax!
  • logsoftmax!
  • conv / conv! (#258)
  • maxpool / maxpool! (#258)
  • meanpool / meanpool! (#258)
  • batched_mul / batched_mul! (#258)
  • padding
    • pad_constant
    • pad_circular
    • pad_repeat
    • pad_zeros
    • pad_reflect
    • pad_symmetric
  • ∇conv_data / ∇conv_data!
  • ∇conv_filter / ∇conv_filter!
  • gather / gather!
  • scatter / scatter! https://github.com/EnzymeAD/Reactant.jl/pull/1395
  • dot_product_attention
  • pixel_shuffle
  • batchnorm (has a special stablehlo impl) - this needs to wait for a corresponding adjoint on EnzymeJAX end
  • grid_sample / grid_sample!
  • upsampling
    • nearest
    • linear
    • bilinear
    • trilinear
  • fold / fold!
  • unfold / unfold!

Some of these might not even be needed, but we should test the generated IR. Strikethrough denotes we don't need specialized handling for these operations

Feel free to add missing operations to the list

Contributor Guide