LuxTTS

 

This is the model for LuxTTS, a lightweight zipvoice based text-to-speech model designed for high quality voice cloning and realistic generation at speeds exceeding 150x realtime.

Main features

• Voice cloning: SOTA voice cloning on par with models 10x larger.
• Clarity: Clear 48khz speech generation unlike most TTS models which are limited to 24khz.
• Speed: Reaches speeds of 150x realtime on a single GPU and faster then realtime on CPU's as well.
• Efficiency: Fits within 1gb vram meaning it can fit in any local gpu.

Details

• Based on ZipVoice, distilled to 4steps.
• Uses 48khz vocoder instead of 24khz vocoder.
• Implemented higher quality sampling technique then standard euler.

Usage

Please check out the repo for usage: https://github.com/ysharma3501/LuxTTS.git

License

Model and code is released under Apache-2.0 license.

If you find the model/code helpful, stars or likes would be appreciated. Thank you.