Mimi Codec

Standalone Rust implementation of the Mimi streaming neural audio codec, extracted from the Moshi monorepo. Includes a native Candle backend, ONNX Runtime backend, JNI bridge for Android, and Python bindings.

24 kHz mono audio, 12.5 Hz frame rate, configurable 1–32 codebooks.

Crates

ONNX Streaming Models

Pre-exported streaming ONNX models are available on Hugging Face: BMekiker/mimi-onnx-streaming

The FP16 variants store weights as float16 (~40% smaller) while keeping float32 graph I/O. Computation runs in float32 at runtime — no quality loss, drop-in replacement.

Exporting ONNX models

pip install torch transformers onnx onnxruntime

# Export FP32 models
python scripts/export_streaming_onnx.py --num-codebooks 8 --output-dir onnx-models/streaming-8cb
python scripts/export_streaming_onnx.py --num-codebooks 16 --output-dir onnx-models/streaming-16cb

# Convert to weight-only FP16
python scripts/weight_fp16.py --input-dir onnx-models/streaming-8cb --output-dir onnx-models/streaming-8cb-fp16
python scripts/weight_fp16.py --input-dir onnx-models/streaming-16cb --output-dir onnx-models/streaming-16cb-fp16

The exported models accept any chunk size that is a multiple of 80ms (1920 samples) at runtime — the chunk size is not baked into the graph.

CLI Usage

# Build
cargo build --release -p mimi-cli

# Roundtrip (encode + decode)
mimi-cli roundtrip --input test.wav --output out.wav --num-codebooks 8

# ONNX backend
mimi-cli roundtrip --input test.wav --output out.wav \
  --backend onnx \
  --encoder-model onnx-models/streaming-8cb/encoder_model.onnx \
  --decoder-model onnx-models/streaming-8cb/decoder_model.onnx \
  --num-codebooks 8 --streaming

Building for Android

mimi-jni uses a vendored, lightly-patched copy of candle-core (see candle-core-patched/) via a [patch.crates-io] entry in mimi-jni/Cargo.toml. The patch is candle-core 0.9.2 plus runtime ARM dotprod (SDOT) detection, which makes quantized (GGUF) int8 inference ~3× faster on ARMv8.2+ devices while still falling back to the plain NEON path on older ARMv8.0 hardware. No extra setup is required — the crate is checked into this repo.

cargo install cargo-ndk

cd mimi-jni
cargo ndk -t arm64-v8a -P 24 build --release --features onnx

# Copy .so to the Android project
cp target/aarch64-linux-android/release/libmimi_jni.so \
   ../MimiDemo/app/src/main/jniLibs/arm64-v8a/

Scripts

License

This project contains code derived from Moshi by Kyutai.

• Code: MIT License — see LICENSE
• Model weights (Mimi codec): CC-BY 4.0 by Kyutai