FireRedTeam/FireRedASR2-LLM

Model

24

stars

7

commits

2

repos using this model

4

linked in READMEs

Mar 13, 2026

updated

asr
audio
automatic-speech-recognition
safetensors

README

FireRedASR2S
A SOTA Industrial-Grade All-in-One ASR System

[Code] [Paper] [Model] [Blog] [Demo]

FireRedASR2-LLM is the 8B+ parameter variant of the FireRedASR2 system, designed to achieve state-of-the-art performance and enable seamless end-to-end speech interaction. It adopts an Encoder-Adapter-LLM framework leveraging large language model capabilities.

The model was introduced in the paper FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition System.

Authors: Kaituo Xu, Yan Jia, Kai Huang, Junjie Chen, Wenpeng Li, Kun Liu, Feng-Long Xie, Xu Tang, Yao Hu.

🔥 News

  • [2026.03.12] 🔥 We release FireRedASR2S technical report. See arXiv.
  • [2026.03.05] 🚀 vLLM supports FireRedASR2-LLM.
  • [2026.02.25] 🔥 We release FireRedASR2-LLM model weights. 🤗 🤖

Sample Usage

To use this model, please refer to the installation and setup instructions in the official GitHub repository.

from fireredasr2s.fireredasr2 import FireRedAsr2, FireRedAsr2Config

batch_uttid = ["hello_zh", "hello_en"]
batch_wav_path = ["assets/hello_zh.wav", "assets/hello_en.wav"]

# FireRedASR2-LLM Configuration
asr_config = FireRedAsr2Config(
    use_gpu=True,
    decode_min_len=0,
    repetition_penalty=1.0,
    llm_length_penalty=0.0,
    temperature=1.0
)

# Load the model
model = FireRedAsr2.from_pretrained("llm", "FireRedTeam/FireRedASR2-LLM", asr_config)

# Transcribe
results = model.transcribe(batch_uttid, batch_wav_path)
print(results)
# [{'uttid': 'hello_zh', 'text': '你好世界', 'rtf': '0.0681', 'wav': 'assets/hello_zh.wav'}, {'uttid': 'hello_en', 'text': 'hello speech', 'rtf': '0.0681', 'wav': 'assets/hello_en.wav'}]

Evaluation

FireRedASR2-LLM achieves state-of-the-art accuracy across Mandarin and various Chinese dialects.

MetricFireRedASR2-LLMDoubao-ASRQwen3-ASRFun-ASR
Avg CER (Mandarin, 4 sets)2.893.693.764.16
Avg CER (Dialects, 19 sets)11.5515.3911.8512.76

FAQ

Q: What audio format is supported? 16kHz 16-bit mono PCM wav. You can convert files using ffmpeg: ffmpeg -i <input_audio_path> -ar 16000 -ac 1 -acodec pcm_s16le -f wav <output_wav_path>

Q: What are the input length limitations? FireRedASR2-LLM supports audio input up to 40s.

Citation

@article{xu2026fireredasr2s,
  title={FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition System},
  author={Xu, Kaituo and Jia, Yan and Huang, Kai and Chen, Junjie and Li, Wenpeng and Liu, Kun and Xie, Feng-Long and Tang, Xu and Hu, Yao},
  journal={arXiv preprint arXiv:2603.10420},
  year={2026}
}

Contributors

FI
FireRedTeam

5 commits

FT
FireRed Team

1 commits

nielsr

1 commits

FireRedTeam/FireRedASR2-LLM

Model

24

stars

7

commits

2

repos using this model

4

linked in READMEs

Mar 13, 2026

updated

asr
audio
automatic-speech-recognition
safetensors

README

FireRedASR2S
A SOTA Industrial-Grade All-in-One ASR System

[Code] [Paper] [Model] [Blog] [Demo]

FireRedASR2-LLM is the 8B+ parameter variant of the FireRedASR2 system, designed to achieve state-of-the-art performance and enable seamless end-to-end speech interaction. It adopts an Encoder-Adapter-LLM framework leveraging large language model capabilities.

The model was introduced in the paper FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition System.

Authors: Kaituo Xu, Yan Jia, Kai Huang, Junjie Chen, Wenpeng Li, Kun Liu, Feng-Long Xie, Xu Tang, Yao Hu.

🔥 News

  • [2026.03.12] 🔥 We release FireRedASR2S technical report. See arXiv.
  • [2026.03.05] 🚀 vLLM supports FireRedASR2-LLM.
  • [2026.02.25] 🔥 We release FireRedASR2-LLM model weights. 🤗 🤖

Sample Usage

To use this model, please refer to the installation and setup instructions in the official GitHub repository.

from fireredasr2s.fireredasr2 import FireRedAsr2, FireRedAsr2Config

batch_uttid = ["hello_zh", "hello_en"]
batch_wav_path = ["assets/hello_zh.wav", "assets/hello_en.wav"]

# FireRedASR2-LLM Configuration
asr_config = FireRedAsr2Config(
    use_gpu=True,
    decode_min_len=0,
    repetition_penalty=1.0,
    llm_length_penalty=0.0,
    temperature=1.0
)

# Load the model
model = FireRedAsr2.from_pretrained("llm", "FireRedTeam/FireRedASR2-LLM", asr_config)

# Transcribe
results = model.transcribe(batch_uttid, batch_wav_path)
print(results)
# [{'uttid': 'hello_zh', 'text': '你好世界', 'rtf': '0.0681', 'wav': 'assets/hello_zh.wav'}, {'uttid': 'hello_en', 'text': 'hello speech', 'rtf': '0.0681', 'wav': 'assets/hello_en.wav'}]

Evaluation

FireRedASR2-LLM achieves state-of-the-art accuracy across Mandarin and various Chinese dialects.

MetricFireRedASR2-LLMDoubao-ASRQwen3-ASRFun-ASR
Avg CER (Mandarin, 4 sets)2.893.693.764.16
Avg CER (Dialects, 19 sets)11.5515.3911.8512.76

FAQ

Q: What audio format is supported? 16kHz 16-bit mono PCM wav. You can convert files using ffmpeg: ffmpeg -i <input_audio_path> -ar 16000 -ac 1 -acodec pcm_s16le -f wav <output_wav_path>

Q: What are the input length limitations? FireRedASR2-LLM supports audio input up to 40s.

Citation

@article{xu2026fireredasr2s,
  title={FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition System},
  author={Xu, Kaituo and Jia, Yan and Huang, Kai and Chen, Junjie and Li, Wenpeng and Liu, Kun and Xie, Feng-Long and Tang, Xu and Hu, Yao},
  journal={arXiv preprint arXiv:2603.10420},
  year={2026}
}

Contributors

FI
FireRedTeam

5 commits

FT
FireRed Team

1 commits

nielsr

1 commits