RVC-Project/Retrieval-based-Voice-Conversion-WebUI

GANs

Open

#2,012 opened on Apr 23, 2024

View on GitHub
 (2 comments) (4 reactions) (0 assignees)Python (18,427 stars) (2,849 forks)batch import
enhancementhelp wanted

Description

I will make this short and quick for all of you to read. I think it would be a good idea if hifigan was switched with bigvgan for better fidelity and mel representation, or at the very least vocos. It would probably be a good idea to have this change included with RVC v3. @RVC-Boss

Contributor guide

Tech stack
pythonpytorch
Domain
machine learningai
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
over 1 week
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
unclear
Prerequisites
Understanding of GANsFamiliarity with PyTorchKnowledge of RVC codebase
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20
Research direction
Investigate the current implementation of HiFi GAN in the RVC project, likely in the models or modules directory. Compare it with BigVGAN and Vocos architectures. Determine the necessary changes to the training and inference code. Review any existing discussions or PRs related to model upgrades. Provide a clear proposal with estimated effort and expected improvements in fidelity.
GANs · RVC-Project/Retrieval-based-Voice-Conversion-WebUI#2012 | Good First Issue