Repository Issues

A PyTorch implementation of the Decoupled LionW optimizer, an adaptive optimization algorithm with customizable learning rates and weight decay. This optimizer combines gradient updates and momentum while providing metrics such as cosine similarity and l2 norm for analysis