AU

AutoArk-AI/GPA-v1.5

Model

27

stars

6

commits

1

linked in READMEs

Apr 29, 2026

updated

arkasr
audio
automatic-speech-recognition
custom_code
safetensors
speech
text-generation
text-to-speech
transformers
voice-conversion
Browse cluster: Speech Recognition and Audio Processing

README

GPA Logo

GPA v1.5: One Model for Speech Recognition, Text-to-Speech, and Voice Conversion

ArXiv GitHub Demo ONNX Runtime Assets

TL;DR This is the main Hugging Face checkpoint repo for GPA v1.5. Use it for native PyTorch / Hugging Face inference and fine-tuning. Runtime-optimized ONNX assets are published separately at AutoArk-AI/GPA-v1.5-onnx-runtime.

What Is GPA v1.5?

GPA stands for General Purpose Audio.

GPA v1.5 is a unified autoregressive audio-language model for speech understanding and generation. It currently supports:

  • ASR: automatic speech recognition.
  • TTS: text-to-speech with reference voice conditioning.
  • Training / fine-tuning: native Hugging Face Trainer workflow.
  • Deployment path: ONNX runtime assets and service code for local CLI, FastAPI, and browser UI testing.

Voice conversion support in the native v1.5 path is on the roadmap.

GPA v1.5 unified speech model overview
GPA unifies speech understanding and generation in a single autoregressive audio-language model.

Hugging Face and GitHub Mapping

This Hugging Face repo stores the large checkpoint assets. The code, examples, and docs live in the GitHub repo:

GoalGitHub Entry PointHugging Face Assets
Native PyTorch / Hugging Face inferenceGPA_1.5/docs/infer.md, GPA_1.5/infer.pyThis repo: AutoArk-AI/GPA-v1.5
Fine-tuning / continued trainingGPA_1.5/docs/train.md, GPA_1.5/train.pyThis repo: AutoArk-AI/GPA-v1.5
ONNX CLI / FastAPI / browser UI runtimeGPA_1.5/onnx_runtime/README.mdAutoArk-AI/GPA-v1.5-onnx-runtime

For the least configuration, keep the checkpoint repos side by side:

GPA-v1.5/
GPA-v1.5-HF/
  GPA-v1.5/
    spark_tokenizer_model/
  GPA-v1.5-onnx-runtime/

What each path is used for:

  • GPA-v1.5-HF/GPA-v1.5: native PyTorch train / inference checkpoint.
  • GPA-v1.5-HF/GPA-v1.5/spark_tokenizer_model: Spark tokenizer assets used by native TTS.
  • GPA-v1.5-HF/GPA-v1.5-onnx-runtime: ONNX CLI / service / browser UI asset bundle.

With this layout, the native inference, training, and ONNX smoke tests can run without editing source paths.

Download

git clone https://github.com/AutoArk/GPA.git GPA-v1.5
mkdir -p GPA-v1.5-HF

huggingface-cli download AutoArk-AI/GPA-v1.5 \
  --local-dir GPA-v1.5-HF/GPA-v1.5

huggingface-cli download AutoArk-AI/GPA-v1.5-onnx-runtime \
  --local-dir GPA-v1.5-HF/GPA-v1.5-onnx-runtime

Where To Start

GPA v1.5 Release Overview

GPA v1.5
CheckpointOpen-sourced on Hugging Face
Native inferenceDirect PyTorch / Hugging Face execution for ASR and TTS
Native trainingFine-tuning and continued training with Hugging Face Trainer
ONNX runtimeCLI inference, FastAPI service, browser UI, voice registration, and runtime validation
PlannedVoice conversion support in the native v1.5 path

Evaluation Metric Results

TTS Evaluation

ModelOpen-SourceModel Sizetest-zh CER (%) ↓test-zh Sim (%) ↑test-en WER (%) ↓test-en Sim (%) ↑
Human--1.2675.52.1473.4
Seed-TTSNo-1.1279.62.2576.2
MiniMax-SpeechNo-0.8378.31.6569.2
F5-TTSYes0.3B1.5274.12.0064.7
CosyVoice2Yes0.5B1.4575.72.5765.9
FireRedTTS2Yes1.5B1.1473.21.9566.5
Index-TTS2Yes1.5B1.0376.52.2370.6
VibeVoice-1.5BYes1.5B1.1674.43.0468.9
VoxCPMYes0.5B0.9377.21.8572.9
Fun-CosyVoice3-0.5B-2512_RLYes0.5B0.8177.41.6869.5
Spark TTSYes0.5B1.2066.01.9857.3
GPA-v1.5Yes0.6B1.0370.21.4363.5

ASR Evaluation

WER (%) is reported for LibriSpeech. CER (%) is reported for AISHELL-1.

ModelModel SizeLibriSpeech test-cleanLibriSpeech test-otherAISHELL-1test_Meetingtest_Net
Whisper-S0.24B3.437.63---
GPA-v1.50.6B2.785.022.837.406.49
Fun-ASR-nano0.8B1.764.331.806.606.01
FireRed-ASR1.1B1.844.520.544.954.94
GLM-ASR-nano1.5B2.004.191.816.73-
Whisper-L1.55B1.863.434.7218.3911.89
Kimi-Audio-1.322.630.716.246.45
Step-Audio2-1.172.420.634.754.67
Seed-ASR-1.582.840.685.694.66
Fun-ASR7.7B1.513.031.226.175.46

License

This model is released under the Apache 2.0 license.

Citation

If you find GPA useful for your research or projects, please cite us:

@misc{cai2026unifyingspeechrecognitionsynthesis,
      title={Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformers},
      author={Runyuan Cai and Yu Lin and Yiming Wang and Chunlin Fu and Xiaodong Zeng},
      year={2026},
      eprint={2601.10770},
      archivePrefix={arXiv},
      primaryClass={cs.SD},
      url={https://arxiv.org/abs/2601.10770},
}

Contributors

chua

6 commits

AU

AutoArk-AI/GPA-v1.5

Model

27

stars

6

commits

1

linked in READMEs

Apr 29, 2026

updated

arkasr
audio
automatic-speech-recognition
custom_code
safetensors
speech
text-generation
text-to-speech
transformers
voice-conversion
Browse cluster: Speech Recognition and Audio Processing

README

GPA Logo

GPA v1.5: One Model for Speech Recognition, Text-to-Speech, and Voice Conversion

ArXiv GitHub Demo ONNX Runtime Assets

TL;DR This is the main Hugging Face checkpoint repo for GPA v1.5. Use it for native PyTorch / Hugging Face inference and fine-tuning. Runtime-optimized ONNX assets are published separately at AutoArk-AI/GPA-v1.5-onnx-runtime.

What Is GPA v1.5?

GPA stands for General Purpose Audio.

GPA v1.5 is a unified autoregressive audio-language model for speech understanding and generation. It currently supports:

  • ASR: automatic speech recognition.
  • TTS: text-to-speech with reference voice conditioning.
  • Training / fine-tuning: native Hugging Face Trainer workflow.
  • Deployment path: ONNX runtime assets and service code for local CLI, FastAPI, and browser UI testing.

Voice conversion support in the native v1.5 path is on the roadmap.

GPA v1.5 unified speech model overview
GPA unifies speech understanding and generation in a single autoregressive audio-language model.

Hugging Face and GitHub Mapping

This Hugging Face repo stores the large checkpoint assets. The code, examples, and docs live in the GitHub repo:

GoalGitHub Entry PointHugging Face Assets
Native PyTorch / Hugging Face inferenceGPA_1.5/docs/infer.md, GPA_1.5/infer.pyThis repo: AutoArk-AI/GPA-v1.5
Fine-tuning / continued trainingGPA_1.5/docs/train.md, GPA_1.5/train.pyThis repo: AutoArk-AI/GPA-v1.5
ONNX CLI / FastAPI / browser UI runtimeGPA_1.5/onnx_runtime/README.mdAutoArk-AI/GPA-v1.5-onnx-runtime

For the least configuration, keep the checkpoint repos side by side:

GPA-v1.5/
GPA-v1.5-HF/
  GPA-v1.5/
    spark_tokenizer_model/
  GPA-v1.5-onnx-runtime/

What each path is used for:

  • GPA-v1.5-HF/GPA-v1.5: native PyTorch train / inference checkpoint.
  • GPA-v1.5-HF/GPA-v1.5/spark_tokenizer_model: Spark tokenizer assets used by native TTS.
  • GPA-v1.5-HF/GPA-v1.5-onnx-runtime: ONNX CLI / service / browser UI asset bundle.

With this layout, the native inference, training, and ONNX smoke tests can run without editing source paths.

Download

git clone https://github.com/AutoArk/GPA.git GPA-v1.5
mkdir -p GPA-v1.5-HF

huggingface-cli download AutoArk-AI/GPA-v1.5 \
  --local-dir GPA-v1.5-HF/GPA-v1.5

huggingface-cli download AutoArk-AI/GPA-v1.5-onnx-runtime \
  --local-dir GPA-v1.5-HF/GPA-v1.5-onnx-runtime

Where To Start

GPA v1.5 Release Overview

GPA v1.5
CheckpointOpen-sourced on Hugging Face
Native inferenceDirect PyTorch / Hugging Face execution for ASR and TTS
Native trainingFine-tuning and continued training with Hugging Face Trainer
ONNX runtimeCLI inference, FastAPI service, browser UI, voice registration, and runtime validation
PlannedVoice conversion support in the native v1.5 path

Evaluation Metric Results

TTS Evaluation

ModelOpen-SourceModel Sizetest-zh CER (%) ↓test-zh Sim (%) ↑test-en WER (%) ↓test-en Sim (%) ↑
Human--1.2675.52.1473.4
Seed-TTSNo-1.1279.62.2576.2
MiniMax-SpeechNo-0.8378.31.6569.2
F5-TTSYes0.3B1.5274.12.0064.7
CosyVoice2Yes0.5B1.4575.72.5765.9
FireRedTTS2Yes1.5B1.1473.21.9566.5
Index-TTS2Yes1.5B1.0376.52.2370.6
VibeVoice-1.5BYes1.5B1.1674.43.0468.9
VoxCPMYes0.5B0.9377.21.8572.9
Fun-CosyVoice3-0.5B-2512_RLYes0.5B0.8177.41.6869.5
Spark TTSYes0.5B1.2066.01.9857.3
GPA-v1.5Yes0.6B1.0370.21.4363.5

ASR Evaluation

WER (%) is reported for LibriSpeech. CER (%) is reported for AISHELL-1.

ModelModel SizeLibriSpeech test-cleanLibriSpeech test-otherAISHELL-1test_Meetingtest_Net
Whisper-S0.24B3.437.63---
GPA-v1.50.6B2.785.022.837.406.49
Fun-ASR-nano0.8B1.764.331.806.606.01
FireRed-ASR1.1B1.844.520.544.954.94
GLM-ASR-nano1.5B2.004.191.816.73-
Whisper-L1.55B1.863.434.7218.3911.89
Kimi-Audio-1.322.630.716.246.45
Step-Audio2-1.172.420.634.754.67
Seed-ASR-1.582.840.685.694.66
Fun-ASR7.7B1.513.031.226.175.46

License

This model is released under the Apache 2.0 license.

Citation

If you find GPA useful for your research or projects, please cite us:

@misc{cai2026unifyingspeechrecognitionsynthesis,
      title={Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformers},
      author={Runyuan Cai and Yu Lin and Yiming Wang and Chunlin Fu and Xiaodong Zeng},
      year={2026},
      eprint={2601.10770},
      archivePrefix={arXiv},
      primaryClass={cs.SD},
      url={https://arxiv.org/abs/2601.10770},
}

Contributors

chua

6 commits