Shadowgraph
TrendingBuzzAbout
Sign in

ColorfulAI/VoiceAssistant_units

Dataset

We use mHuBERT and K-means Model to convert answer from VoiceAssistant (synthesized by vits) to units.

0

4 commits

2 linked in READMEs

updated Apr 2, 2025

See the code

README

We use mHuBERT and K-means Model to convert answer from VoiceAssistant (synthesized by vits) to units.

  • *pred* indicates the answer from the speech model
  • *gt* indicates the answer from the ground-truth

For usage, please refer to Open-Omni-Nexus

Similar repos

ColorfulAI/LLaVA-NeXT-Speech

Dataset

we randomly select 300k visual instructions from LLaVA-NeXT, and convert the user queries into…

0

MatthewCYM/VoiceBench

[TACL'26] VoiceBench: Benchmarking LLM-Based Voice Assistants

400

fushh7/ViSpeak-Bench

Dataset

0

maitrix-org/Voila-Benchmark

Dataset

💜 Project Page &nbsp&nbsp ｜ &nbsp&nbsp 🖥️ GitHub &nbsp&nbsp | &nbsp&nbsp🤗 Hugging Face&nbsp&nbsp…

3

hlt-lab/voicebench

Dataset

License

16

vogent/Vogent-Turn-80M

Model

15

SatsukiVie/FusionAudio

Dataset

10

brgroup/BR-Voice-Reasoner

Model

BR-Voice-Reasoner

2

Linked in READMEs

OmniMMI/OpenOmniNexus

a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.

39

README badge

patrick-tssn/Open-Omni-Nexus

a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.

39

README badge

ColorfulAI/VoiceAssistant_units

Dataset

We use mHuBERT and K-means Model to convert answer from VoiceAssistant (synthesized by vits) to units.

0

4 commits

2 linked in READMEs

updated Apr 2, 2025

See the code

README

We use mHuBERT and K-means Model to convert answer from VoiceAssistant (synthesized by vits) to units.

  • *pred* indicates the answer from the speech model
  • *gt* indicates the answer from the ground-truth

For usage, please refer to Open-Omni-Nexus

Similar repos

ColorfulAI/LLaVA-NeXT-Speech

Dataset

we randomly select 300k visual instructions from LLaVA-NeXT, and convert the user queries into…

0

MatthewCYM/VoiceBench

[TACL'26] VoiceBench: Benchmarking LLM-Based Voice Assistants

400

fushh7/ViSpeak-Bench

Dataset

0

maitrix-org/Voila-Benchmark

Dataset

💜 Project Page &nbsp&nbsp ｜ &nbsp&nbsp 🖥️ GitHub &nbsp&nbsp | &nbsp&nbsp🤗 Hugging Face&nbsp&nbsp…

3

hlt-lab/voicebench

Dataset

License

16

vogent/Vogent-Turn-80M

Model

15

SatsukiVie/FusionAudio

Dataset

10

brgroup/BR-Voice-Reasoner

Model

BR-Voice-Reasoner

2

Linked in READMEs

OmniMMI/OpenOmniNexus

a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.

39

README badge

patrick-tssn/Open-Omni-Nexus

a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.

39

README badge