About

VoxCPM2 is a tokenizer-free Text-to-Speech model trained on over 2 million hours of multilingual speech data. Built on a MiniCPM-4 backbone with AudioVAE V2, it outputs 48kHz studio-quality audio and supports 30 languages with no language tag needed.

This custom node provides two inference nodes and a full LoRA training pipeline, all integrated directly into ComfyUI — based on the original ComfyUI-VoxCPM by @wildminder.

Key Features:

• 30-Language Multilingual — Input text in any supported language, no language tag needed
• Voice Design — Generate a novel voice from a natural-language description alone (gender, age, tone, emotion, pace)
• Controllable Voice Cloning — Clone any voice from a short reference clip, with optional style guidance
• Ultimate Cloning — Provide reference audio + transcript for maximum fidelity reproduction
• 48kHz Studio-Quality Output — Accepts 16kHz reference audio, outputs 48kHz via AudioVAE V2's built-in super-resolution
• LoRA Support — Load fine-tuned LoRA checkpoints for specific voice styles
• Native LoRA Training — Train LoRA adapters directly within ComfyUI
• Automatic Model Management — Models are downloaded and managed by ComfyUI to save VRAM
• Torch Compile — Optional torch.compile optimization for faster inference
• ASR Auto-Transcription — Auto-transcribe reference audio using SenseVoiceSmall (requires funasr)
• Reference Audio Denoiser — Optional ZipEnhancer denoising for cleaner cloning (requires modelscope)
• Loudness Normalization — Auto-normalize output loudness when denoiser is active
• Audio Duration Validation — Rejects reference audio over 50 seconds to prevent quality issues

Installation

Via ComfyUI Manager (Recommended)

Search for ComfyUI-VoxCPM2 and click "Install".

Manual

1. Clone into your ComfyUI/custom_nodes/ directory:

   git clone https://github.com/Saganaki22/ComfyUI-VoxCPM2.git
   

2. Install dependencies:

   cd ComfyUI-VoxCPM2
   pip install -r requirements.txt
   

Python 3.13+ on Windows: If pip install fails on editdistance with a pdm.backend import error or C4819 encoding warning, run:

pip install pdm-backend
set CL=/utf-8    # CMD
# or in PowerShell: $env:CL="/utf-8"
pip install -r requirements.txt

3. Restart ComfyUI. Nodes appear under the audio/tts category.

Models

The model is downloaded automatically on first use to ComfyUI/models/tts/VoxCPM/.

Nodes

VoxCPM2 TTS

Text-to-speech with optional voice design. No reference audio needed.

VoxCPM2 Voice Clone

Voice cloning with controllable and ultimate modes.

Usage

Text-to-Speech (Zero-Shot)

1. Add the VoxCPM2 TTS node to your workflow.
2. Type your text in the text field.
3. Optionally describe a voice in voice_description (e.g. "A deep male voice, calm and authoritative").
4. Queue the prompt.

Voice Design

The voice_description field lets you create any voice without reference audio:

• "A young woman, gentle and sweet voice"
• "An old man with a gravelly, slow voice"
• "A child, excited and energetic"

The description is automatically wrapped in parentheses and prepended to your text, matching the VoxCPM2 API format (description)text.

Controllable Voice Cloning

1. Add the VoxCPM2 Voice Clone node.
2. Connect a Load Audio node to reference_audio.
3. Enter your target text in text.
4. Optionally add style guidance in voice_description (e.g. "slightly faster, cheerful tone").
5. Leave prompt_text empty. Optionally enable enable_asr to auto-transcribe the reference audio.

Ultimate Cloning (Highest Fidelity)

1. Same as above, but also provide the exact transcript of the reference audio in prompt_text.
2. The model uses audio-continuation cloning to reproduce every vocal nuance.
3. If you don't have a transcript, enable enable_asr — it will auto-transcribe and enter Ultimate mode automatically.

ASR Auto-Transcription

Enable enable_asr on either node to automatically transcribe reference audio using the SenseVoiceSmall model. The first run downloads the model (~400MB). Requires pip install funasr.

When enable_asr is on:

• If prompt_text is empty, ASR runs and fills it automatically (enters Ultimate Cloning)
• If prompt_text is already provided, ASR is skipped and the manual transcript is used instead

Reference Audio Denoiser

Enable enable_denoiser on the Voice Clone node to clean up noisy reference audio before cloning. Uses ZipEnhancer via ModelScope. Requires pip install modelscope.

When the denoiser is active, the output audio loudness is automatically normalized to -20 LUFS for consistent volume.

Reference Audio Duration

Reference audio is validated on upload — audio longer than 50 seconds will be rejected with an error. For best results, use 5–15 seconds of clean, continuous speech.

LoRA Support

Inference

1. Place .safetensors LoRA files in ComfyUI/models/loras/.
2. Select your LoRA in the lora_name dropdown.

Training

Train custom LoRA adapters directly in ComfyUI using the training nodes (VoxCPM2 Train Config, VoxCPM2 Dataset Maker, VoxCPM2 LoRA Trainer).

Click here for the full LoRA Training Guide

Tips for Best Results

Voice Cloning

• Use clean, high-quality reference audio (5–15 seconds of continuous speech)
• For Ultimate Cloning, provide an accurate verbatim transcript in prompt_text
• Punctuation in the transcript helps the model capture intonation

Generation Quality

• cfg_value (default 2.0): Raise for more adherence to the prompt, lower for more natural variation
• inference_timesteps (default 10): 5–10 for fast drafts, 15–25 for higher quality
• normalize_text: Keep ON for natural language input. Turn OFF only for phoneme input like {HH AH0 L OW1}

Supported Languages (30)

Arabic, Burmese, Chinese, Danish, Dutch, English, Finnish, French, German, Greek, Hebrew, Hindi, Indonesian, Italian, Japanese, Khmer, Korean, Lao, Malay, Norwegian, Polish, Portuguese, Russian, Spanish, Swahili, Swedish, Tagalog, Thai, Turkish, Vietnamese

Chinese Dialects: Sichuan, Cantonese, Wu, Northeastern, Henan, Shaanxi, Shandong, Tianjin, Southern Min

Limitations

• Voice Design and Style Control results may vary between runs; generating 1–3 times is recommended
• Performance varies across languages depending on training data availability
• Occasional instability with very long or highly expressive inputs
• Strictly forbidden to use for impersonation, fraud, or disinformation. AI-generated content should be clearly labeled.

License

The VoxCPM model and its components are subject to the Apache-2.0 License provided by OpenBMB.

Acknowledgments

• @wildminder for the original ComfyUI-VoxCPM this project is based on
• OpenBMB & ModelBest for creating and open-sourcing VoxCPM
• The ComfyUI team for their powerful and extensible platform