k2-fsa/ZipVoice

Model

62

stars

44

commits

6

repos using this model

2

linked in READMEs

Jul 9, 2026

updated

onnx
safetensors
text-to-speech

README

ZipVoice⚡: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching

This model consists of checkpoints for two fast and high-quality non-autoregressive zero-shot text-to-speech models:

  • ZipVoice, for single-speaker speech generation. Details in paper and demo.

  • ZipVoice-Dialog, for spoken dialogue generation. Details in paper and demo.

See our Github repository ZipVoice for instructions on using our models.

1. Explanation of each directory

DirectoryModel TypeTraining DataInitialized from
zipvoiceZipVoiceEmilia-
zipvoice_librittsZipVoiceLibriTTS-
zipvoice_distillZipVoice-DistillEmiliazipvoice/model.pt
zipvoice_distill_librittsZipVoice-DistillLibriTTSzipvoice_libritts/model.pt
zipvoice_dialogZipVoice-DialogOpenDialog + in-house datasetzipvoice/model.pt
zipvoice_dialog_opendialogZipVoice-DialogOpenDialogzipvoice/model.pt
zipvoice_dialog_stereoZipVoice-Dialog-Stereoin-house datasetzipvoice_dialog/model.pt

2. Discussion & Communication

You can directly discuss on Github Issues.

You can also scan the QR code to join our wechat group or follow our wechat official account.

Wechat GroupWechat Official Account
wechatwechat

3. Citation

@article{zhu2025zipvoice,
      title={ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching},
      author={Zhu, Han and Kang, Wei and Yao, Zengwei and Guo, Liyong and Kuang, Fangjun and Li, Zhaoqing and Zhuang, Weiji and Lin, Long and Povey, Daniel},
      journal={arXiv preprint arXiv:2506.13053},
      year={2025}
}

@article{zhu2025zipvoicedialog,
      title={ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching},
      author={Zhu, Han and Kang, Wei and Guo, Liyong and Yao, Zengwei and Kuang, Fangjun and Zhuang, Weiji and Li, Zhaoqing and Han, Zhifeng and Zhang, Dong and Zhang, Xin and Song, Xingchen and Lin, Long and Povey, Daniel},
      journal={arXiv preprint arXiv:2507.09318},
      year={2025}
}

Contributors

zhu-han

35 commits

pkufool

6 commits

csukuangfj

1 commits

nielsr

1 commits

k2-fsa/ZipVoice

Model

62

stars

44

commits

6

repos using this model

2

linked in READMEs

Jul 9, 2026

updated

onnx
safetensors
text-to-speech

README

ZipVoice⚡: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching

This model consists of checkpoints for two fast and high-quality non-autoregressive zero-shot text-to-speech models:

  • ZipVoice, for single-speaker speech generation. Details in paper and demo.

  • ZipVoice-Dialog, for spoken dialogue generation. Details in paper and demo.

See our Github repository ZipVoice for instructions on using our models.

1. Explanation of each directory

DirectoryModel TypeTraining DataInitialized from
zipvoiceZipVoiceEmilia-
zipvoice_librittsZipVoiceLibriTTS-
zipvoice_distillZipVoice-DistillEmiliazipvoice/model.pt
zipvoice_distill_librittsZipVoice-DistillLibriTTSzipvoice_libritts/model.pt
zipvoice_dialogZipVoice-DialogOpenDialog + in-house datasetzipvoice/model.pt
zipvoice_dialog_opendialogZipVoice-DialogOpenDialogzipvoice/model.pt
zipvoice_dialog_stereoZipVoice-Dialog-Stereoin-house datasetzipvoice_dialog/model.pt

2. Discussion & Communication

You can directly discuss on Github Issues.

You can also scan the QR code to join our wechat group or follow our wechat official account.

Wechat GroupWechat Official Account
wechatwechat

3. Citation

@article{zhu2025zipvoice,
      title={ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching},
      author={Zhu, Han and Kang, Wei and Yao, Zengwei and Guo, Liyong and Kuang, Fangjun and Li, Zhaoqing and Zhuang, Weiji and Lin, Long and Povey, Daniel},
      journal={arXiv preprint arXiv:2506.13053},
      year={2025}
}

@article{zhu2025zipvoicedialog,
      title={ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching},
      author={Zhu, Han and Kang, Wei and Guo, Liyong and Yao, Zengwei and Kuang, Fangjun and Zhuang, Weiji and Li, Zhaoqing and Han, Zhifeng and Zhang, Dong and Zhang, Xin and Song, Xingchen and Lin, Long and Povey, Daniel},
      journal={arXiv preprint arXiv:2507.09318},
      year={2025}
}

Contributors

zhu-han

35 commits

pkufool

6 commits

csukuangfj

1 commits

nielsr

1 commits