Omi Med STT v1 GGUF

GGUF export of Omi Med STT v1 for Linux and Windows CPU use through the omi-med-stt CLI.

This is the portability path. If you have Apple Silicon, use the MLX q8 repo. If you have an NVIDIA GPU, use the canonical NeMo checkpoint.

Quickstart

pip install -U omi-med-stt
omi-med-stt install-cpp --cpp-backend cpu
omi-med-stt audio.wav --runtime cpp

Files

Evaluation

The public weights are unchanged. These September 2026 results come from the current documented runtime recipes on the same frozen 1,513-clip, 7.18-hour medical benchmark and scorer. No dictionary, custom vocabulary, contextual bias, reference-aware selection, or transcript correction was used.

The CPU path is the portable fallback. It recorded the lowest occurrence-based medical and drug error counts in this draw, but paired tests do not establish it as clinically better than GPU or MLX. Use CUDA for the best WER and throughput, or MLX q8 on Apple Silicon.

The previous model-card figures were produced by an older runtime/scorer path. The numbers above supersede them as runtime results; the GGUF weights did not change.

• Full benchmark and methodology
• Runtime results and platform details
• CPU GGUF recipe

Compatibility

These files are not llama.cpp text-model GGUF files. They require a Parakeet ASR runtime. The supported path is:

omi-med-stt audio.wav --runtime cpp

The CLI installs the patched parakeet.cpp runtime needed for Omi Med STT v1.

Links

• Canonical model: omi-health/omi-med-stt-v1
• Mac q8 default: omi-health/omi-med-stt-v1-mlx-q8
• Runtime CLI: Omi-Health/omi-med-stt-runtime
• Broader evaluation and product context: omi.health/research/omi-med-stt
• parakeet.cpp: mudler/parakeet.cpp

Safety

Omi Med STT v1 is speech-to-text only. It is not a diagnostic, triage, prescribing, or clinical decision model, and it is not clinically validated. Transcripts must be reviewed before any clinical use.