fast tts (ZH EN) lightweight
See the code
The Fastest Voice Cloning System for Real-Time Inference
Zero-shot · Chinese & English · Edge-Deployable · Consumer GPU
🌐 Live Demo · 🚀 Quick Start · 🏗 Architecture · 📊 Evaluation · 🤗 Model Card

English · 中文
VoxFlash-TTS is the fastest voice cloning system in the industry, built around a radically compressed latent diffusion architecture. It supports zero-shot voice cloning in Chinese and English, runs on consumer-grade GPUs, and is designed from the ground up for edge deployment.
The key insight: most TTS inference bottlenecks are a sequence length problem. By compressing 24kHz audio into a 9 Hz latent representation — roughly 8× more compressed than EnCodec — VoxFlash reduces end-to-end compute by orders of magnitude without sacrificing acceptable audio quality.
Generating 10 seconds of audio requires processing just 90 latent vectors, compared to 750+ in conventional systems.
VoxFlash-TTS is built on an ultra-compressed latent diffusion pipeline:
Text Input
│
▼
┌─────────────────────┐
│ Phoneme Encoder │ ConvNeXtV2 — lightweight, hardware-friendly
└─────────────────────┘
│
▼
┌─────────────────────┐
│ Coarse Alignment │ Explicit alignment — lower complexity than Cross-Attention
└─────────────────────┘
│
▼
┌─────────────────────┐
│ Diffusion Model │ Multi-step denoising in latent space (NFE=16)
└─────────────────────┘
│ ▲
│ ┌──────┴──────┐
│ │Speaker Enc. │ Reference audio → speaker embedding
│ └─────────────┘
▼
┌─────────────────────┐
│ VAE Decoder │ 9 Hz latent → 24kHz high-fidelity waveform
└─────────────────────┘
│
▼
Audio Output
| System | Latent Frame Rate | Latent vectors for 10s audio |
|---|---|---|
| EnCodec | ~75 fps | ~750 |
| Speech LM (semantic tokens) | ~50 fps | ~500 |
| Stable Audio | ~21.5 fps | ~215 |
| VoxFlash-TTS | 9 fps | 90 |
Transformer self-attention scales at O(n²) with sequence length. Cutting the sequence by 8× reduces attention compute by ~64×. This is why VoxFlash can deliver millisecond inference where others cannot.
2026-09-08: Weights updated. See huggingface.co/VoxFlashTTS/VoxFlashTTS
2026-07-14: Weights updated. See huggingface.co/VoxFlashTTS/VoxFlashTTS
# Pull the image
docker pull berlinisaiah/ttsv2:v8
# Background mode (production)
docker container run -d --gpus all \
--mount type=bind,source=$(pwd)/resources,target=/app/resources \
-p 8000:8000 berlinisaiah/ttsv2:v8
# Foreground mode (debug)
docker container run -it --gpus all \
--mount type=bind,source=$(pwd)/resources,target=/app/resources \
-p 8000:8000 berlinisaiah/ttsv2:v8
Open your browser and navigate to:
http://127.0.0.1:8000/demo.html
| Language | Same-language Cloning | Cross-lingual Cloning |
|---|---|---|
| Chinese (Mandarin) | ✅ | ✅ |
| English | ✅ | ✅ |
No fine-tuning needed. Provide any reference audio clip and VoxFlash extracts a speaker embedding, injects it into the diffusion process, and outputs speech matching the target voice.
Cross-lingual cloning (e.g. Chinese reference → English output) is supported, demonstrating effective disentanglement of voice timbre from language identity.
Audio samples are drawn from the Seed-TTS evaluation set for direct comparison with leading systems.
| System | Inference Speed | Deployment | Zero-Shot | Cross-lingual |
|---|---|---|---|---|
| Seed-TTS | Slow | Cloud GPU | ✅ | ✅ |
| CosyVoice 2 | Medium | Medium | ✅ | ✅ |
| FastSpeech variants | Fast | Low | ❌ | ❌ |
| VoxFlash-TTS | Fastest | Edge / Consumer GPU | ✅ | ✅ |
👉 Listen to audio samples at voxflash.github.io
| Scenario | Key Requirement | VoxFlash Advantage |
|---|---|---|
| Real-time voice interaction | Low first-packet latency | Short latent sequences, fewer diffusion steps |
| Large-scale batch synthesis | Throughput & GPU cost | Orders-of-magnitude compute reduction |
| Edge / on-device deployment | Low VRAM & power draw | Lightweight architecture, consumer GPU capable |
| Individual developers | Simple setup | One Docker command, no tuning required |
| File | Size | Contents |
|---|---|---|
main_model.onnx | 697 MB | Phoneme Encoder + Diffusion Model + Speaker Encoder |
vae_decode.onnx | 51.5 MB | VAE Decoder |
vae_encode.onnx | 46.1 MB | VAE Encoder |
vocoder.onnx | 59.7 MB | Vocoder |
| Total | ~854 MB | Full pipeline |
If VoxFlash-TTS has been useful in your research or engineering work, please cite:
@misc{voxflash2026,
title = {VoxFlash-TTS: Ultra-Compressed Latent Diffusion for Real-Time Voice Cloning},
author = {VoxFlash},
year = {2026},
url = {https://github.com/VoxFlash/VoxFlashTTS},
note = {GitHub repository}
}
Contributions, issues, and feature requests are welcome. Please open an issue first to discuss what you would like to change.
This project is licensed under the Apache 2.0 License.
Scan the QR code below to join the VoxFlash-TTS Voice Cloning Group on WeChat:
QR code valid for 7 days. Please re-enter the group if it expires.
Not the most expressive TTS — the fastest, lightest, and easiest-to-deploy voice cloning system.
75 commits
fast tts (ZH EN) lightweight
See the code
The Fastest Voice Cloning System for Real-Time Inference
Zero-shot · Chinese & English · Edge-Deployable · Consumer GPU
🌐 Live Demo · 🚀 Quick Start · 🏗 Architecture · 📊 Evaluation · 🤗 Model Card

English · 中文
VoxFlash-TTS is the fastest voice cloning system in the industry, built around a radically compressed latent diffusion architecture. It supports zero-shot voice cloning in Chinese and English, runs on consumer-grade GPUs, and is designed from the ground up for edge deployment.
The key insight: most TTS inference bottlenecks are a sequence length problem. By compressing 24kHz audio into a 9 Hz latent representation — roughly 8× more compressed than EnCodec — VoxFlash reduces end-to-end compute by orders of magnitude without sacrificing acceptable audio quality.
Generating 10 seconds of audio requires processing just 90 latent vectors, compared to 750+ in conventional systems.
VoxFlash-TTS is built on an ultra-compressed latent diffusion pipeline:
Text Input
│
▼
┌─────────────────────┐
│ Phoneme Encoder │ ConvNeXtV2 — lightweight, hardware-friendly
└─────────────────────┘
│
▼
┌─────────────────────┐
│ Coarse Alignment │ Explicit alignment — lower complexity than Cross-Attention
└─────────────────────┘
│
▼
┌─────────────────────┐
│ Diffusion Model │ Multi-step denoising in latent space (NFE=16)
└─────────────────────┘
│ ▲
│ ┌──────┴──────┐
│ │Speaker Enc. │ Reference audio → speaker embedding
│ └─────────────┘
▼
┌─────────────────────┐
│ VAE Decoder │ 9 Hz latent → 24kHz high-fidelity waveform
└─────────────────────┘
│
▼
Audio Output
| System | Latent Frame Rate | Latent vectors for 10s audio |
|---|---|---|
| EnCodec | ~75 fps | ~750 |
| Speech LM (semantic tokens) | ~50 fps | ~500 |
| Stable Audio | ~21.5 fps | ~215 |
| VoxFlash-TTS | 9 fps | 90 |
Transformer self-attention scales at O(n²) with sequence length. Cutting the sequence by 8× reduces attention compute by ~64×. This is why VoxFlash can deliver millisecond inference where others cannot.
2026-09-08: Weights updated. See huggingface.co/VoxFlashTTS/VoxFlashTTS
2026-07-14: Weights updated. See huggingface.co/VoxFlashTTS/VoxFlashTTS
# Pull the image
docker pull berlinisaiah/ttsv2:v8
# Background mode (production)
docker container run -d --gpus all \
--mount type=bind,source=$(pwd)/resources,target=/app/resources \
-p 8000:8000 berlinisaiah/ttsv2:v8
# Foreground mode (debug)
docker container run -it --gpus all \
--mount type=bind,source=$(pwd)/resources,target=/app/resources \
-p 8000:8000 berlinisaiah/ttsv2:v8
Open your browser and navigate to:
http://127.0.0.1:8000/demo.html
| Language | Same-language Cloning | Cross-lingual Cloning |
|---|---|---|
| Chinese (Mandarin) | ✅ | ✅ |
| English | ✅ | ✅ |
No fine-tuning needed. Provide any reference audio clip and VoxFlash extracts a speaker embedding, injects it into the diffusion process, and outputs speech matching the target voice.
Cross-lingual cloning (e.g. Chinese reference → English output) is supported, demonstrating effective disentanglement of voice timbre from language identity.
Audio samples are drawn from the Seed-TTS evaluation set for direct comparison with leading systems.
| System | Inference Speed | Deployment | Zero-Shot | Cross-lingual |
|---|---|---|---|---|
| Seed-TTS | Slow | Cloud GPU | ✅ | ✅ |
| CosyVoice 2 | Medium | Medium | ✅ | ✅ |
| FastSpeech variants | Fast | Low | ❌ | ❌ |
| VoxFlash-TTS | Fastest | Edge / Consumer GPU | ✅ | ✅ |
👉 Listen to audio samples at voxflash.github.io
| Scenario | Key Requirement | VoxFlash Advantage |
|---|---|---|
| Real-time voice interaction | Low first-packet latency | Short latent sequences, fewer diffusion steps |
| Large-scale batch synthesis | Throughput & GPU cost | Orders-of-magnitude compute reduction |
| Edge / on-device deployment | Low VRAM & power draw | Lightweight architecture, consumer GPU capable |
| Individual developers | Simple setup | One Docker command, no tuning required |
| File | Size | Contents |
|---|---|---|
main_model.onnx | 697 MB | Phoneme Encoder + Diffusion Model + Speaker Encoder |
vae_decode.onnx | 51.5 MB | VAE Decoder |
vae_encode.onnx | 46.1 MB | VAE Encoder |
vocoder.onnx | 59.7 MB | Vocoder |
| Total | ~854 MB | Full pipeline |
If VoxFlash-TTS has been useful in your research or engineering work, please cite:
@misc{voxflash2026,
title = {VoxFlash-TTS: Ultra-Compressed Latent Diffusion for Real-Time Voice Cloning},
author = {VoxFlash},
year = {2026},
url = {https://github.com/VoxFlash/VoxFlashTTS},
note = {GitHub repository}
}
Contributions, issues, and feature requests are welcome. Please open an issue first to discuss what you would like to change.
This project is licensed under the Apache 2.0 License.
Scan the QR code below to join the VoxFlash-TTS Voice Cloning Group on WeChat:
QR code valid for 7 days. Please re-enter the group if it expires.
Not the most expressive TTS — the fastest, lightest, and easiest-to-deploy voice cloning system.
75 commits