倉庫議題
kyegomez/DecoupledLionW
A PyTorch implementation of the Decoupled LionW optimizer, an adaptive optimization algorithm with customizable learning rates and weight decay. This optimizer combines gradient updates and momentum while providing metrics such as cosine similarity and l2 norm for analysis
議題
此倉庫沒有開放的已索引議題。