Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fixed-step generator #5

Open
HaiFengZeng opened this issue Dec 11, 2024 · 3 comments
Open

fixed-step generator #5

HaiFengZeng opened this issue Dec 11, 2024 · 3 comments

Comments

@HaiFengZeng
Copy link

Looking forward the code open source! the paper mentioned modifying the pre-trained CFM generator into fixed-step generator, can u describe more details?

@sh-lee-prml
Copy link
Owner

sh-lee-prml commented Dec 11, 2024

Hi @HaiFengZeng

Thanks for your interest. Code will be released after paper notification (on 22. Jan. 2025).

Initially, we pre-trained PeriodWave with continuous time t using the Flow Matching objective (LR: 2e-4), allowing us to sample the waveform from x_t0 using any ODE solvers.

For faster sampling, we fine-tuned PeriodWave by generating the waveform signal from x_t0 using 2 or 4 fixed step sampling with an Euler Solver.
We then optimized the generator using adversarial training and Mel reconstruction losses similar to conventional GAN-based neural vocoder. (LR: 2e-5, it is important to decrease the learning rate)

This new training framework for neural vocoders significantly reduces the overall training time.

Thanks

@HaiFengZeng
Copy link
Author

@sh-lee-prml Hi, dear friend, have u prepared for releasing the code?

@sh-lee-prml
Copy link
Owner

Hi @HaiFengZeng

I'm currently tied up with some other tasks. But, I'll do my best to update the code by Feb. 10.

Thank you for your patience.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants