trongnguyen24/OmniVoice-Studio-new

stars

144

commits

Python

primary language

May 12, 2026

updated

README

OmniVoice Studio

The open-source ElevenLabs alternative.

Real-time dictation, zero-shot voice cloning, and cinematic video dubbing — all on your desktop.
Open-source, no API keys, fully local. 646 languages.

Quickstart · Features · Why OmniVoice Studio? · TTS Engines · Contributing · Discord

OmniVoice Studio — The open-source ElevenLabs alternative

[!WARNING] OmniVoice Studio is in active beta. Things may break between releases. For the latest features and fixes, clone the repo and run from source rather than using pre-built installers. Bug reports and PRs are very welcome — open an issue or join Discord.

Features

🎙️ Voice Cloning

3-second clip → mirror any voice.
646 languages, zero-shot.

🎨 Voice Design

Gender, age, accent, pitch, speed,
emotion, dialect — dial it in.

🎬 Video Dubbing

YouTube URL or file → transcribe →
translate → re-voice → MP4.

⌘+⇧+Space from any app.
Transcribes, auto-pastes, disappears.

🔊 Vocal Isolation

Demucs-powered. Splits speech
from music, keeps the background.

👥 Speaker Diarization

Pyannote + WhisperX.
Auto-identifies who said what.

📦 Batch Queue

Drop 50 videos, walk away.
Progress bars per job.

🤖 MCP Server

Use OmniVoice from Claude,
Cursor, or any MCP client.

🛡️ AI Watermark

AudioSeal (Meta). Invisible,
survives compression.

🔐 100% Local

No keys, no cloud, no accounts.
Your machine only.

⚡ GPU Auto-Detect

CUDA · MPS · ROCm · CPU.
≤8 GB? Auto-offloads.

🧩 Extensible

Subclass TTSBackend,
add any engine in ~50 lines.

Quickstart

Pick your path — from zero-install to full developer setup:

🖥️ Desktop App

_{Easiest · ~2 min · No dependencies}

_{macOS DMG · Windows MSI · Linux AppImage/deb
Auto-bootstraps Python + models on first launch.}

🐳 Docker

_{One command · ~3 min · Needs Docker}

docker pull ghcr.io/debpalash/omnivoice-studio

_{Pre-built image from GHCR.
CPU + NVIDIA GPU supported.}

⚡ From Source

_{Full control · ~5 min · Needs Bun + Python}

git clone → bun install → bun run dev

_{Hot reload, full codebase access.
Best for contributors.}

🖥️ Option 1 — Desktop App

Pre-built installers (~6–8 MB) are on the Releases page. Download, install, launch. The app bootstraps a Python environment and downloads model weights automatically — the splash screen shows progress.

macOS — "app is damaged and can't be opened"

macOS quarantines apps downloaded outside the App Store. After dragging to /Applications:

xattr -cr /Applications/OmniVoice\ Studio.app

Open normally after. One-time fix.

Windows — first launch takes 5–10 minutes

The app bootstraps a Python virtual environment, installs dependencies, and downloads ffmpeg on first run. The splash screen shows each step. Subsequent launches start in seconds.

Linux — AppImage needs FUSE

If FUSE isn't available, use the .deb package or extract-and-run:

chmod +x OmniVoice.Studio_*.AppImage
./OmniVoice.Studio_*.AppImage --appimage-extract-and-run

🐳 Option 2 — Docker

Pull the pre-built image from GitHub Container Registry:

docker pull ghcr.io/debpalash/omnivoice-studio:latest

Run it:

# CPU mode
docker run -d --name omnivoice \
  -p 127.0.0.1:3900:3900 \
  -v omnivoice-data:/app/omnivoice_data \
  ghcr.io/debpalash/omnivoice-studio:latest

# NVIDIA GPU mode
docker run -d --name omnivoice --gpus all \
  -p 127.0.0.1:3900:3900 \
  -v omnivoice-data:/app/omnivoice_data \
  ghcr.io/debpalash/omnivoice-studio:latest

Or use Docker Compose:

# CPU
docker compose -f deploy/docker-compose.yml up -d

# GPU
docker compose -f deploy/docker-compose.yml --profile gpu up -d

Open localhost:3900 once the health check passes. First run downloads ~4 GB of model weights — progress in docker compose logs -f.

Build from source instead of pulling

docker compose -f deploy/docker-compose.yml up --build -d

Network access: the container binds to 127.0.0.1 only. To expose on your LAN, change the port mapping to "0.0.0.0:3900:3900". OmniVoice ships no authentication — put it behind a reverse proxy with auth (Caddy basic_auth, nginx + htpasswd, Tailscale, etc.).

⚡ Option 3 — From Source

git clone https://github.com/debpalash/OmniVoice-Studio.git && cd OmniVoice-Studio
bun install && bun run dev

Open localhost:3901 and start cloning voices. Hot-reload enabled for both frontend and backend.

bun run desktop    # Build the native desktop app from source

Service	URL	Stack
Backend	`localhost:3900`	FastAPI · 97 endpoints · WhisperX · Demucs · OmniVoice
Frontend	`localhost:3901`	React · Vite · Waveform timeline · Glassmorphism UI
API Docs	`localhost:3900/docs`	Scalar — interactive API reference

[!NOTE] First run downloads model weights (~2.4 GB). No account needed. For faster downloads, optionally set HF_TOKEN=hf_... in your environment (get a free token here).

Having issues? Join our Discord for setup help and troubleshooting.

Screenshots

Voice Clone _{Drop a 3-second clip → mirror any voice. 646 languages, zero-shot.}	Voice Design _{Build new voices from scratch — gender, age, accent, pitch, style.}
Video Dubbing _{Upload or paste a YouTube URL. Transcribe, translate, re-voice, export.}	Voice Gallery _{Search YouTube, browse categories, download clips, build your library.}
Settings → Models _{15 models. One-click install. Auto-detects your platform (CUDA / MPS / CPU).}	Projects _{Dub projects, voice profiles, generation history, exports — all searchable.}
Settings → Logs _{Live backend, frontend, and Tauri runtime logs. Filter, refresh, clear.}

Why OmniVoice Studio?

ElevenLabs charges $5–$330/mo and processes your audio on their servers. OmniVoice Studio runs on your hardware, with no usage limits.

	ElevenLabs	OmniVoice Studio
Pricing	$5–$330/mo, per-character billing	Free for personal use · Commercial license for business
Voice Cloning	✅ 3s clip	✅ 3s clip, zero-shot
Voice Design	✅ Gender, age	✅ Gender, age, accent, pitch, style, dialect
Languages	32	646
Video Dubbing	✅ Cloud-only	✅ Fully local
Data Privacy	Audio sent to cloud	Nothing leaves your machine
API Keys	Required	Not needed
GPU Support	N/A (cloud)	CUDA · Apple Silicon · ROCm · CPU
Desktop App	❌	✅ macOS · Windows · Linux
Customizable	❌ Closed	✅ Fork it, extend it, ship it

OmniVoice Studio gives you professional-grade AI tools without the subscription or the cloud.

System Requirements

	Minimum	Recommended
OS	Windows 10, macOS 12+, Ubuntu 20.04+	Any modern 64-bit OS
RAM	8 GB	16 GB+
VRAM (GPU)	4 GB (auto-offloads TTS to CPU)	8 GB+ (NVIDIA RTX 3060+)
Disk	10 GB free (models + cache)	20 GB+ SSD
Python	3.10+ (managed by `uv`)	3.11–3.12
GPU	Optional — CPU works	NVIDIA CUDA · Apple Silicon MPS · AMD ROCm

[!TIP] On GPUs with ≤8 GB VRAM, OmniVoice automatically offloads TTS to CPU during transcription — no config needed. A dedicated GPU is not required; the entire pipeline runs on CPU (just slower).

TTS Engines

OmniVoice ships a multi-engine TTS backend. The default engine (OmniVoice) is always available; additional engines are opt-in and auto-detected. Switch engines in Settings → TTS Engine or via the OMNIVOICE_TTS_BACKEND env var.

Engine	Languages	Clone	Instruct	Linux	macOS ARM	Windows	License
OmniVoice (default)	600+	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Built-in
CosyVoice 3	9 + 18 dialects	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Apache-2.0
MLX-Audio (Kokoro, Qwen3-TTS, CSM, Dia, …)	Multi	Varies	Varies	❌	✅ Native	❌	Varies
VoxCPM2	30	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Apache-2.0
MOSS-TTS-Nano	20	✅	❌	✅ CUDA/CPU	✅ CPU	✅ CUDA/CPU	Apache-2.0
KittenTTS	English	❌	❌	✅ CPU	✅ CPU	✅ CPU	MIT

CUDA = GPU-accelerated · MPS = Apple Silicon Metal · CPU = runs everywhere, slower for large models · KittenTTS and MOSS-TTS-Nano run realtime on CPU · MLX-Audio is Apple Silicon only.

Architecture

┌─────────────────────────────────────────────────┐
│                  Frontend (React)                │
│  DubTab · VoicePreview · BatchQueue · Gallery    │
├─────────────────────────────────────────────────┤
│                Backend (FastAPI)                  │
│  97 API endpoints · SSE streaming · SQLite       │
├──────────┬──────────┬──────────┬────────────────┤
│ WhisperX │  Demucs  │OmniVoice │   Pyannote     │
│   ASR    │  Source  │   TTS    │  Diarization   │
│          │  Sep.    │          │                │
└──────────┴──────────┴──────────┴────────────────┘
        CUDA / MPS / ROCm / CPU (auto-detected)

Roadmap

✅ Shipped

Category	Features
Dubbing	Full pipeline (transcribe→translate→synthesize→mux), scene-aware splitting, lip-sync scoring, streaming TTS
Voice	Zero-shot cloning, voice design, A/B comparison, voice preview widget, gallery with favorites/tags
Audio	Demucs vocal isolation, per-segment gain, selective track export, stem/SRT/VTT/MP3 export
Multi-Lang	Multi-language batch picker, batch dubbing queue with sequential GPU execution
Diarization	Pyannote ML diarization, auto speaker clone extraction, per-speaker voice assignment
Infra	Docker deployment, CUDA/MPS/ROCm auto-detect, cuDNN 8 compat, VRAM-aware model offloading
AI Provenance	AudioSeal invisible watermarking (SynthID-like), video logo overlay, watermark detection API
UX	Undo/redo, keyboard shortcuts, drag-and-drop, session persistence, glassmorphism design system
Real-time Events	WebSocket event bus — instant sidebar refresh on data mutations, exponential backoff reconnect
State Management	Zustand store migration — `uiSlice`, `pillSlice`, `dubSlice`, `generateSlice`, `prefsSlice`, `glossarySlice`
Desktop	Cross-platform Tauri installers (macOS DMG, Windows MSI, Linux deb/AppImage), auto-update infrastructure
Windows Hardening	Cross-platform log paths, Triton workaround, HF symlink bypass, 300s health check timeout
Dictation	Global system-wide hotkey (`⌘+⇧+Space`), frameless floating widget, streaming ASR via WebSocket, auto-paste
Batch Pipeline	Full batch TTS: extract → transcribe → translate → generate → mix → export, with live progress tracking

🔜 Up Next

🎬 Lip-sync v2 — visual speech timing with wav2lip
📖 Audiobook Editor — chapter-aware long-form narration
🌐 Hosted Demo — try OmniVoice without installing anything
🔌 Plugin Marketplace — community-contributed TTS engines and effects

Contributing

We welcome contributions of all kinds — bug fixes, new TTS engine adapters, UI improvements, docs, and translations.

📖 Read the Contributing Guide for setup, code style, and PR workflow
🐛 Browse good first issues
💬 Join our Discord to discuss ideas or ask for help

FAQ

Is this really as good as ElevenLabs?

For voice cloning and dubbing, yes — OmniVoice uses a state-of-the-art diffusion TTS model with 646 languages (ElevenLabs supports 32). Quality is comparable for most use cases. Where ElevenLabs wins is in their polished cloud API and pre-made voice library. OmniVoice wins on privacy, cost, language coverage, and customizability.

Does it work on Apple Silicon (M1/M2/M3/M4)?

Yes. MPS acceleration is auto-detected. MLX-optimized Whisper models are available for faster transcription on Apple hardware.

How much VRAM do I need?

4 GB minimum. With ≤8 GB, the TTS model is automatically offloaded to CPU during transcription. With 8+ GB, everything runs on GPU simultaneously. No GPU at all? CPU mode works — just slower (~3× for TTS).

Can I use this commercially?

Personal, educational, internal-team, and non-commercial use is free under FSL-1.1-ALv2. Building a competing product or service on top of OmniVoice Studio requires a commercial license — see License. Pricing tiers coming soon. Each release converts to Apache 2.0 two years after publication.

What languages are supported?

646 languages for TTS via the OmniVoice model. Transcription (WhisperX) supports 99 languages. Translation coverage depends on the target language pair.

Can I add my own TTS engine?

Yes. OmniVoice uses a built-in backend registry. To add an engine in ~50 lines, subclass TTSBackend in backend/services/tts_backend.py and add it to the _REGISTRY dictionary at the bottom. Six engines are built in: OmniVoice, CosyVoice, MLX-Audio (14+ sub-engines), VoxCPM2, MOSS-TTS-Nano, and KittenTTS. See the TTS Engines section for details.

License

OmniVoice Studio is source-available under the Functional Source License (FSL-1.1-ALv2).

Free for personal, educational, research, internal team, and non-commercial use. Each release converts to Apache 2.0 automatically two years after publication.

Business / enterprise users building a competing product or service on top of OmniVoice Studio need a commercial license. Pricing tiers coming soon. For inquiries in the meantime, reach out at OmniVoice@palash.dev.

See LICENSE for the full terms.

Acknowledgments

OmniVoice Studio is built on the shoulders of exceptional open-source work:

Project	Role
OmniVoice (k2-fsa)	Zero-shot diffusion TTS engine — the core voice synthesis model
WhisperX	Word-level speech recognition and alignment
Demucs (Meta)	Music source separation for vocal isolation
Pyannote	Speaker diarization — who said what
CTranslate2	Optimized Transformer inference on CPU and GPU
AudioSeal (Meta)	Invisible neural audio watermarking for AI provenance
Tauri	Native desktop app framework

If you read this far, you're our kind of person.
⭐ Star this repo so others can find it too.

Contributors

135 commits

6 commits

2 commits

1 commits

Similar repos

gmossy/omnivoice-studio

Clone a voice, design a new one, or dub a video into any of 646 languages. Built for creators who…

ThanhNguyenVN93/OmniVoice-Studio

shivam-dubey-byte/omivoice-studio

Standalone mirror of debpalash/OmniVoice-Studio

debpalash/VoiceStudio

VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design,…

21,995

Gerrymckendrygit/voicebox

Voicebox - cloned from jamiepine/voicebox

FranckyB/Voice-Clone-Studio

A Gradio-based web UI for voice cloning and voice design, powered by Qwen3-TTS & VibeVoice. Can…

668

timoncool/dub-studio

Free offline AI video dubbing studio for Windows — voice cloning, translation, subtitles &…

118

akarsh911/OmniPlay

End-to-end pipeline to translate videos with speaker diarization, subtitle generation, and voice…

Languages

Python

51.3%

JavaScript

26.0%

CSS

12.9%

Shell

3.8%

Rust

2.8%

TypeScript

2.5%

trongnguyen24/OmniVoice-Studio-new

stars

144

commits

Python

primary language

May 12, 2026

updated

README

OmniVoice Studio

The open-source ElevenLabs alternative.

Real-time dictation, zero-shot voice cloning, and cinematic video dubbing — all on your desktop.
Open-source, no API keys, fully local. 646 languages.

Quickstart · Features · Why OmniVoice Studio? · TTS Engines · Contributing · Discord

[!WARNING] OmniVoice Studio is in active beta. Things may break between releases. For the latest features and fixes, clone the repo and run from source rather than using pre-built installers. Bug reports and PRs are very welcome — open an issue or join Discord.

Features

🎙️ Voice Cloning

3-second clip → mirror any voice.
646 languages, zero-shot.

🎨 Voice Design

Gender, age, accent, pitch, speed,
emotion, dialect — dial it in.

🎬 Video Dubbing

YouTube URL or file → transcribe →
translate → re-voice → MP4.

⌘+⇧+Space from any app.
Transcribes, auto-pastes, disappears.

🔊 Vocal Isolation

Demucs-powered. Splits speech
from music, keeps the background.

👥 Speaker Diarization

Pyannote + WhisperX.
Auto-identifies who said what.

📦 Batch Queue

Drop 50 videos, walk away.
Progress bars per job.

🤖 MCP Server

Use OmniVoice from Claude,
Cursor, or any MCP client.

🛡️ AI Watermark

AudioSeal (Meta). Invisible,
survives compression.

🔐 100% Local

No keys, no cloud, no accounts.
Your machine only.

⚡ GPU Auto-Detect

CUDA · MPS · ROCm · CPU.
≤8 GB? Auto-offloads.

🧩 Extensible

Subclass TTSBackend,
add any engine in ~50 lines.

Quickstart

Pick your path — from zero-install to full developer setup:

🖥️ Desktop App

_{Easiest · ~2 min · No dependencies}

_{macOS DMG · Windows MSI · Linux AppImage/deb
Auto-bootstraps Python + models on first launch.}

🐳 Docker

_{One command · ~3 min · Needs Docker}

docker pull ghcr.io/debpalash/omnivoice-studio

_{Pre-built image from GHCR.
CPU + NVIDIA GPU supported.}

⚡ From Source

_{Full control · ~5 min · Needs Bun + Python}

git clone → bun install → bun run dev

_{Hot reload, full codebase access.
Best for contributors.}

🖥️ Option 1 — Desktop App

macOS — "app is damaged and can't be opened"

macOS quarantines apps downloaded outside the App Store. After dragging to /Applications:

xattr -cr /Applications/OmniVoice\ Studio.app

Open normally after. One-time fix.

Windows — first launch takes 5–10 minutes

The app bootstraps a Python virtual environment, installs dependencies, and downloads ffmpeg on first run. The splash screen shows each step. Subsequent launches start in seconds.

Linux — AppImage needs FUSE

If FUSE isn't available, use the .deb package or extract-and-run:

chmod +x OmniVoice.Studio_*.AppImage
./OmniVoice.Studio_*.AppImage --appimage-extract-and-run

🐳 Option 2 — Docker

Pull the pre-built image from GitHub Container Registry:

docker pull ghcr.io/debpalash/omnivoice-studio:latest

Run it:

# CPU mode
docker run -d --name omnivoice \
  -p 127.0.0.1:3900:3900 \
  -v omnivoice-data:/app/omnivoice_data \
  ghcr.io/debpalash/omnivoice-studio:latest

# NVIDIA GPU mode
docker run -d --name omnivoice --gpus all \
  -p 127.0.0.1:3900:3900 \
  -v omnivoice-data:/app/omnivoice_data \
  ghcr.io/debpalash/omnivoice-studio:latest

Or use Docker Compose:

# CPU
docker compose -f deploy/docker-compose.yml up -d

# GPU
docker compose -f deploy/docker-compose.yml --profile gpu up -d

Open localhost:3900 once the health check passes. First run downloads ~4 GB of model weights — progress in docker compose logs -f.

Build from source instead of pulling

docker compose -f deploy/docker-compose.yml up --build -d

Network access: the container binds to 127.0.0.1 only. To expose on your LAN, change the port mapping to "0.0.0.0:3900:3900". OmniVoice ships no authentication — put it behind a reverse proxy with auth (Caddy basic_auth, nginx + htpasswd, Tailscale, etc.).

⚡ Option 3 — From Source

git clone https://github.com/debpalash/OmniVoice-Studio.git && cd OmniVoice-Studio
bun install && bun run dev

Open localhost:3901 and start cloning voices. Hot-reload enabled for both frontend and backend.

bun run desktop    # Build the native desktop app from source

Service	URL	Stack
Backend	`localhost:3900`	FastAPI · 97 endpoints · WhisperX · Demucs · OmniVoice
Frontend	`localhost:3901`	React · Vite · Waveform timeline · Glassmorphism UI
API Docs	`localhost:3900/docs`	Scalar — interactive API reference

[!NOTE] First run downloads model weights (~2.4 GB). No account needed. For faster downloads, optionally set HF_TOKEN=hf_... in your environment (get a free token here).

Having issues? Join our Discord for setup help and troubleshooting.

Screenshots

Voice Clone _{Drop a 3-second clip → mirror any voice. 646 languages, zero-shot.}	Voice Design _{Build new voices from scratch — gender, age, accent, pitch, style.}
Video Dubbing _{Upload or paste a YouTube URL. Transcribe, translate, re-voice, export.}	Voice Gallery _{Search YouTube, browse categories, download clips, build your library.}
Settings → Models _{15 models. One-click install. Auto-detects your platform (CUDA / MPS / CPU).}	Projects _{Dub projects, voice profiles, generation history, exports — all searchable.}
Settings → Logs _{Live backend, frontend, and Tauri runtime logs. Filter, refresh, clear.}

Why OmniVoice Studio?

ElevenLabs charges $5–$330/mo and processes your audio on their servers. OmniVoice Studio runs on your hardware, with no usage limits.

	ElevenLabs	OmniVoice Studio
Pricing	$5–$330/mo, per-character billing	Free for personal use · Commercial license for business
Voice Cloning	✅ 3s clip	✅ 3s clip, zero-shot
Voice Design	✅ Gender, age	✅ Gender, age, accent, pitch, style, dialect
Languages	32	646
Video Dubbing	✅ Cloud-only	✅ Fully local
Data Privacy	Audio sent to cloud	Nothing leaves your machine
API Keys	Required	Not needed
GPU Support	N/A (cloud)	CUDA · Apple Silicon · ROCm · CPU
Desktop App	❌	✅ macOS · Windows · Linux
Customizable	❌ Closed	✅ Fork it, extend it, ship it

OmniVoice Studio gives you professional-grade AI tools without the subscription or the cloud.

System Requirements

	Minimum	Recommended
OS	Windows 10, macOS 12+, Ubuntu 20.04+	Any modern 64-bit OS
RAM	8 GB	16 GB+
VRAM (GPU)	4 GB (auto-offloads TTS to CPU)	8 GB+ (NVIDIA RTX 3060+)
Disk	10 GB free (models + cache)	20 GB+ SSD
Python	3.10+ (managed by `uv`)	3.11–3.12
GPU	Optional — CPU works	NVIDIA CUDA · Apple Silicon MPS · AMD ROCm

[!TIP] On GPUs with ≤8 GB VRAM, OmniVoice automatically offloads TTS to CPU during transcription — no config needed. A dedicated GPU is not required; the entire pipeline runs on CPU (just slower).

TTS Engines

Engine	Languages	Clone	Instruct	Linux	macOS ARM	Windows	License
OmniVoice (default)	600+	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Built-in
CosyVoice 3	9 + 18 dialects	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Apache-2.0
MLX-Audio (Kokoro, Qwen3-TTS, CSM, Dia, …)	Multi	Varies	Varies	❌	✅ Native	❌	Varies
VoxCPM2	30	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Apache-2.0
MOSS-TTS-Nano	20	✅	❌	✅ CUDA/CPU	✅ CPU	✅ CUDA/CPU	Apache-2.0
KittenTTS	English	❌	❌	✅ CPU	✅ CPU	✅ CPU	MIT

CUDA = GPU-accelerated · MPS = Apple Silicon Metal · CPU = runs everywhere, slower for large models · KittenTTS and MOSS-TTS-Nano run realtime on CPU · MLX-Audio is Apple Silicon only.

Architecture

┌─────────────────────────────────────────────────┐
│                  Frontend (React)                │
│  DubTab · VoicePreview · BatchQueue · Gallery    │
├─────────────────────────────────────────────────┤
│                Backend (FastAPI)                  │
│  97 API endpoints · SSE streaming · SQLite       │
├──────────┬──────────┬──────────┬────────────────┤
│ WhisperX │  Demucs  │OmniVoice │   Pyannote     │
│   ASR    │  Source  │   TTS    │  Diarization   │
│          │  Sep.    │          │                │
└──────────┴──────────┴──────────┴────────────────┘
        CUDA / MPS / ROCm / CPU (auto-detected)

Roadmap

✅ Shipped

Category	Features
Dubbing	Full pipeline (transcribe→translate→synthesize→mux), scene-aware splitting, lip-sync scoring, streaming TTS
Voice	Zero-shot cloning, voice design, A/B comparison, voice preview widget, gallery with favorites/tags
Audio	Demucs vocal isolation, per-segment gain, selective track export, stem/SRT/VTT/MP3 export
Multi-Lang	Multi-language batch picker, batch dubbing queue with sequential GPU execution
Diarization	Pyannote ML diarization, auto speaker clone extraction, per-speaker voice assignment
Infra	Docker deployment, CUDA/MPS/ROCm auto-detect, cuDNN 8 compat, VRAM-aware model offloading
AI Provenance	AudioSeal invisible watermarking (SynthID-like), video logo overlay, watermark detection API
UX	Undo/redo, keyboard shortcuts, drag-and-drop, session persistence, glassmorphism design system
Real-time Events	WebSocket event bus — instant sidebar refresh on data mutations, exponential backoff reconnect
State Management	Zustand store migration — `uiSlice`, `pillSlice`, `dubSlice`, `generateSlice`, `prefsSlice`, `glossarySlice`
Desktop	Cross-platform Tauri installers (macOS DMG, Windows MSI, Linux deb/AppImage), auto-update infrastructure
Windows Hardening	Cross-platform log paths, Triton workaround, HF symlink bypass, 300s health check timeout
Dictation	Global system-wide hotkey (`⌘+⇧+Space`), frameless floating widget, streaming ASR via WebSocket, auto-paste
Batch Pipeline	Full batch TTS: extract → transcribe → translate → generate → mix → export, with live progress tracking

🔜 Up Next

🎬 Lip-sync v2 — visual speech timing with wav2lip
📖 Audiobook Editor — chapter-aware long-form narration
🌐 Hosted Demo — try OmniVoice without installing anything
🔌 Plugin Marketplace — community-contributed TTS engines and effects

Contributing

We welcome contributions of all kinds — bug fixes, new TTS engine adapters, UI improvements, docs, and translations.

📖 Read the Contributing Guide for setup, code style, and PR workflow
🐛 Browse good first issues
💬 Join our Discord to discuss ideas or ask for help

FAQ

Is this really as good as ElevenLabs?

Does it work on Apple Silicon (M1/M2/M3/M4)?

Yes. MPS acceleration is auto-detected. MLX-optimized Whisper models are available for faster transcription on Apple hardware.

How much VRAM do I need?

Can I use this commercially?

What languages are supported?

646 languages for TTS via the OmniVoice model. Transcription (WhisperX) supports 99 languages. Translation coverage depends on the target language pair.

Can I add my own TTS engine?

License

OmniVoice Studio is source-available under the Functional Source License (FSL-1.1-ALv2).

Free for personal, educational, research, internal team, and non-commercial use. Each release converts to Apache 2.0 automatically two years after publication.

See LICENSE for the full terms.

Acknowledgments

OmniVoice Studio is built on the shoulders of exceptional open-source work:

Project	Role
OmniVoice (k2-fsa)	Zero-shot diffusion TTS engine — the core voice synthesis model
WhisperX	Word-level speech recognition and alignment
Demucs (Meta)	Music source separation for vocal isolation
Pyannote	Speaker diarization — who said what
CTranslate2	Optimized Transformer inference on CPU and GPU
AudioSeal (Meta)	Invisible neural audio watermarking for AI provenance
Tauri	Native desktop app framework

If you read this far, you're our kind of person.
⭐ Star this repo so others can find it too.

Similar repos

gmossy/omnivoice-studio

Clone a voice, design a new one, or dub a video into any of 646 languages. Built for creators who…

ThanhNguyenVN93/OmniVoice-Studio

shivam-dubey-byte/omivoice-studio

Standalone mirror of debpalash/OmniVoice-Studio

debpalash/VoiceStudio

VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design,…

21,995

Gerrymckendrygit/voicebox

Voicebox - cloned from jamiepine/voicebox

FranckyB/Voice-Clone-Studio

A Gradio-based web UI for voice cloning and voice design, powered by Qwen3-TTS & VibeVoice. Can…

668

timoncool/dub-studio

Free offline AI video dubbing studio for Windows — voice cloning, translation, subtitles &…

118

akarsh911/OmniPlay

End-to-end pipeline to translate videos with speaker diarization, subtitle generation, and voice…

Contributors

135 commits

6 commits

2 commits

1 commits

Languages

Python

51.3%

JavaScript

26.0%

CSS

12.9%

Shell

3.8%

Rust

2.8%

TypeScript

2.5%

trongnguyen24/OmniVoice-Studio-new

README

OmniVoice Studio

The open-source ElevenLabs alternative.

Features

🎙️ Voice Cloning

🎨 Voice Design

🎬 Video Dubbing

⌨️ Dictation Widget

🔊 Vocal Isolation

👥 Speaker Diarization

📦 Batch Queue

🤖 MCP Server

🛡️ AI Watermark

🔐 100% Local

⚡ GPU Auto-Detect

🧩 Extensible

Quickstart

🖥️ Desktop App

🐳 Docker

⚡ From Source

🖥️ Option 1 — Desktop App

🐳 Option 2 — Docker

⚡ Option 3 — From Source

Screenshots

Why OmniVoice Studio?

System Requirements

TTS Engines

Architecture

Roadmap

✅ Shipped

🔜 Up Next

Contributing

FAQ

License

Acknowledgments

Contributors

Similar repos

Languages

trongnguyen24/OmniVoice-Studio-new

README

OmniVoice Studio

The open-source ElevenLabs alternative.

Features

🎙️ Voice Cloning

🎨 Voice Design

🎬 Video Dubbing

⌨️ Dictation Widget

🔊 Vocal Isolation

👥 Speaker Diarization

📦 Batch Queue

🤖 MCP Server

🛡️ AI Watermark

🔐 100% Local

⚡ GPU Auto-Detect

🧩 Extensible

Quickstart

🖥️ Desktop App

🐳 Docker

⚡ From Source

🖥️ Option 1 — Desktop App

🐳 Option 2 — Docker

⚡ Option 3 — From Source

Screenshots

Why OmniVoice Studio?

System Requirements

TTS Engines

Architecture

Roadmap

✅ Shipped

🔜 Up Next

Contributing

FAQ

License

Acknowledgments

Similar repos

Contributors

Languages