RVC-Project/Retrieval-based-Voice-Conversion-WebUI
Auf GitHub ansehenChange the Optimization Method (AdamW --> diffGrad)
Open
#952 geöffnet am 6. Aug. 2023
good first issue
Repository-Metriken
- Stars
- (18.427 Stars)
- PR-Merge-Metriken
- (Keine gemergten PRs in 30 T)
Beschreibung
Adamw was replaced by a new optimization method - diffgrad. What do you think about it? Will you add it to increase the accuracy in the experiment?
Change
optim_g = torch.optim.AdamW(
net_g.parameters(),
hps.train.learning_rate,
betas=hps.train.betas,
eps=hps.train.eps,
)
optim_d = torch.optim.AdamW(
net_d.parameters(),
hps.train.learning_rate,
betas=hps.train.betas,
eps=hps.train.eps,
)
To
pip install torch-optimizer
...
import torch_optimizer as optimizer
...
optim_g = optimizer.DiffGrad(
net_g.parameters(),
hps.train.learning_rate,
betas=hps.train.betas,
eps=hps.train.eps,
)
optim_d = optimizer.DiffGrad(
net_d.parameters(),
hps.train.learning_rate,
betas=hps.train.betas,
eps=hps.train.eps,
)
Source diffGrad: https://github.com/shivram1987/diffGrad