LuxDL/Lux.jl

Preserve `init` functions for SimpleChains

Open

#582 opened on Apr 10, 2024

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Julia (700 stars) (84 forks)batch import
enhancementgood first issue

Description

Currently we drop all of the init functions from the Lux models. However, for SciML Applications it is quite critical to support those. Proposed solution: Store the lux model along side the equivalent simple chains version. Instead of calling params on the simplechains model call initialparameters on the lux model and then flatten it.

Contributor guide

Tech stack
None
Domain
machine learning
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
mostly clear
Prerequisites
JuliaLux.jlSimpleChains
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
50
Research direction
Examine the Lux.jl source code, particularly where init functions are dropped during conversion to SimpleChains. Look at the current implementation of model conversion and the `initialparameters` function in Lux. Also, review the SimpleChains integration to understand how to store the lux model alongside the simple chains representation. No existing PRs or comments provide additional context.