README
nemotron-speech-streaming-en-0.6b-int4
Quantized ONNX model for streaming speech recognition, derived from altunenes/parakeet-rs (nemotron-speech-streaming-en-0.6b).
Quantization Method
Weight-only int4 quantization (onnxruntime MatMul4BitsQuantizer)
Files
| File | Description |
|---|---|
encoder.onnx | Quantized encoder (stateful, cache-aware streaming) |
decoder_joint.onnx | Quantized decoder + joint network |
tokenizer.model | SentencePiece tokenizer (unchanged from source) |
Usage
These models are designed for use with parakeet-rs
or compatible ONNX Runtime inference pipelines. The encoder is stateful with cache tensors
for streaming inference (cache_last_channel, cache_last_time, cache_last_channel_len).
Source
Quantized from the ONNX models in altunenes/parakeet-rs
subdirectory nemotron-speech-streaming-en-0.6b/.
Contributors
7 commits
Similar repos
README
nemotron-speech-streaming-en-0.6b-int4
Quantized ONNX model for streaming speech recognition, derived from altunenes/parakeet-rs (nemotron-speech-streaming-en-0.6b).
Quantization Method
Weight-only int4 quantization (onnxruntime MatMul4BitsQuantizer)
Files
| File | Description |
|---|---|
encoder.onnx | Quantized encoder (stateful, cache-aware streaming) |
decoder_joint.onnx | Quantized decoder + joint network |
tokenizer.model | SentencePiece tokenizer (unchanged from source) |
Usage
These models are designed for use with parakeet-rs
or compatible ONNX Runtime inference pipelines. The encoder is stateful with cache tensors
for streaming inference (cache_last_channel, cache_last_time, cache_last_channel_len).
Source
Quantized from the ONNX models in altunenes/parakeet-rs
subdirectory nemotron-speech-streaming-en-0.6b/.
Similar repos
Linked in READMEs
Contributors
7 commits