🗣️ Open TTS Tracker

A one stop shop to track all open-access/ source TTS models as they come out. Feel free to make a PR for all those that aren't linked here.

This is aimed as a resource to increase awareness for these models and to make it easier for researchers, developers, and enthusiasts to stay informed about the latest advancements in the field.

[!NOTE]
This repo will only track open source/access codebase TTS models. More motivation for everyone to open-source! 🤗

Capability specifics

Click on this to toggle table visibility

Name	Processor ⚡	Phonetic alphabet 🔤	Insta-clone 👥	Emotional control 🎭	Prompting 📖	Speech control 🎚	Streaming support 🌊	S2S support 🦜	Longform synthesis
Amphion	CUDA		👥	🎭👥	❌
Bark	CUDA		❌	🎭 tags	❌
EmotiVoice
Fish-speech	CUDA	❌	👥	🎭👥	❌	speed / stability 🎚	🌊	🦜	Yes
Glow-TTS
GPT-SoVITS
HierSpeech++		❌	👥	🎭👥	❌	speed / stability 🎚		🦜
IMS-Toucan	CUDA	❌	❌	❌	❌
Kokoro	CPU / CUDA	👥	❌	❌	❌	speed 🎚	🌊	❌
Llasa	CUDA	❌	👥	🎭	❌	❌	❌	❌
MahaTTS
Matcha-TTS		IPA	❌	❌	❌	speed / stability 🎚
MetaVoice-1B	CUDA		👥	🎭👥	❌	stability / similarity 🎚			Yes
Neural-HMM TTS
OpenVoice	CUDA	❌	👥	6-type 🎭 😡😃😭😯🤫😊	❌
OuteTTS	CPU / CUDA	❌	👥	❌	❌	speed 🎚	🌊	❌
OverFlow TTS
pflowTTS
Piper
Pheme	CUDA	❌	👥	🎭👥	❌	stability 🎚
RAD-TTS
Silero
StyleTTS 2	CPU / CUDA	IPA	👥	🎭👥	❌		🌊		Yes
Tacotron 2
TorToiSe TTS		❌	❌	❌	📖		🌊
TTTS	CPU/CUDA	❌	👥
VALL-E
VITS/ MMS-TTS	CUDA	❌	❌	❌	❌	speed 🎚
WhisperSpeech	CUDA	❌	👥	🎭👥	❌	speed 🎚
XTTS	CUDA	❌	👥	🎭👥	❌	speed / stability 🎚	🌊	❌
xVASynth	CPU / CUDA	ARPAbet+	❌	4-type 🎭 😡😃😭😯 per‑phoneme	❌	speed / pitch / energy / 🎭 🎚 per‑phoneme	❌	🦜
Zonos	CUDA	eSpeak	👥	🎭	❌	speed / pitch / quality / emotion 🎚	❌	❌

• Processor - CPU/CUDA/ROCm (single/multi used for inference; Real-time factor should be below 2.0 to qualify for CPU, though some leeway can be given if it supports audio streaming)
• Phonetic alphabet - None/IPA/ARPAbet (Phonetic transcription that allows to control pronunciation of certain words during inference)
• Insta-clone - Yes/No (Zero-shot model for quick voice clone)
• Emotional control - Yes🎭/Strict (Strict, as in has no ability to go in-between states, insta-clone switch/🎭👥)
• Prompting - Yes/No (A side effect of narrator based datasets and a way to affect the emotional state, ElevenLabs docs)
• Streaming support - Yes/No (If it is possible to playback audio that is still being generated)
• Speech control - speed/pitch/ (Ability to change the pitch, duration, energy and/or emotion of generated speech)
• Speech-To-Speech support - Yes/No (Streaming support implies real-time S2S; S2T=>T2S does not count)

How can you help?

Help make this list more complete. Create demos on the Hugging Face Hub and link them here :) Got any questions? Drop me a DM on Twitter @reach_vb.