RSS 2025
Zongzheng Zhang1,2* · Jiawen Yang1* · Ziqiao Peng1 ·
Meng Yang4 · Jianzhu Ma1, Lin Cheng5 · Huazhe Xu3 . Hang Zhao3 and Hao Zhao1,2
1 Institute for AI Industry Research (AIR), Tsinghua University, 2 Beijing Academy of Artificial Intelligence (BAAI),
3 Institute for Interdisciplinary Information Sciences(IIIS), Tsinghua University,
4 MGI Tech, Shenzhen, China, 5 Beihang University
(* indicates equal contribution)
RSS official | Project Page | arXiv | Hardware | Software
Clone the repo:
git clone https://github.com/ZZongzheng0918/Morpheus-Software.git
cd Morpheus-Software
Create conda environment:
conda create -n morpheus python=3.10
conda activate morpheus
pip install torch==2.3.1 torchvision==0.18.1 torchaudio==2.3.1 --index-url https://download.pytorch.org/whl/cu121
pip install -r requirements.txt
Download Blender and put it in this directory.
wget https://ftp.nluug.nl/pub/graphics/blender/release/Blender3.4/blender-3.4.1-linux-x64.tar.xz
tar -xf blender-3.4.1-linux-x64.tar.xz
mv blender-3.4.1-linux-x64 blender && rm blender-3.4.1-linux-x64.tar.xz
Download the pretrained models from model.pth. Put the pretrained models under pretrain_model folder.
Put the audio under aduio folder and run
python demo.py --wav_path "./audio/disgust.wav"
The generated animation will be saved in result folder.
This source code is licensed under the MIT liscence found in the LICENSE file in the root directory of this repository.
If you find this project useful, feel free to cite our work!
@article{zhang2025morpheus,
title={Morpheus: A Neural-driven Animatronic Face with Hybrid Actuation and Diverse Emotion Control},
author={Zhang, Zongzheng and Yang, Jiawen and Peng, Ziqiao and Yang, Meng and Ma, Jianzhu and Cheng, Lin and Xu, Huazhe and Zhao, Hang and Zhao, Hao},
journal={arXiv preprint arXiv:2507.16645},
year={2025}
}
Here are some great resources we benefit:
Thanks to John Hable for sharing his head template under the CC0 license, which is very helpful for us to visualize the results.
7 commits
1 commits
Python
100.0%
RSS 2025
Zongzheng Zhang1,2* · Jiawen Yang1* · Ziqiao Peng1 ·
Meng Yang4 · Jianzhu Ma1, Lin Cheng5 · Huazhe Xu3 . Hang Zhao3 and Hao Zhao1,2
1 Institute for AI Industry Research (AIR), Tsinghua University, 2 Beijing Academy of Artificial Intelligence (BAAI),
3 Institute for Interdisciplinary Information Sciences(IIIS), Tsinghua University,
4 MGI Tech, Shenzhen, China, 5 Beihang University
(* indicates equal contribution)
RSS official | Project Page | arXiv | Hardware | Software
Clone the repo:
git clone https://github.com/ZZongzheng0918/Morpheus-Software.git
cd Morpheus-Software
Create conda environment:
conda create -n morpheus python=3.10
conda activate morpheus
pip install torch==2.3.1 torchvision==0.18.1 torchaudio==2.3.1 --index-url https://download.pytorch.org/whl/cu121
pip install -r requirements.txt
Download Blender and put it in this directory.
wget https://ftp.nluug.nl/pub/graphics/blender/release/Blender3.4/blender-3.4.1-linux-x64.tar.xz
tar -xf blender-3.4.1-linux-x64.tar.xz
mv blender-3.4.1-linux-x64 blender && rm blender-3.4.1-linux-x64.tar.xz
Download the pretrained models from model.pth. Put the pretrained models under pretrain_model folder.
Put the audio under aduio folder and run
python demo.py --wav_path "./audio/disgust.wav"
The generated animation will be saved in result folder.
This source code is licensed under the MIT liscence found in the LICENSE file in the root directory of this repository.
If you find this project useful, feel free to cite our work!
@article{zhang2025morpheus,
title={Morpheus: A Neural-driven Animatronic Face with Hybrid Actuation and Diverse Emotion Control},
author={Zhang, Zongzheng and Yang, Jiawen and Peng, Ziqiao and Yang, Meng and Ma, Jianzhu and Cheng, Lin and Xu, Huazhe and Zhao, Hang and Zhao, Hao},
journal={arXiv preprint arXiv:2507.16645},
year={2025}
}
Here are some great resources we benefit:
Thanks to John Hable for sharing his head template under the CC0 license, which is very helpful for us to visualize the results.
7 commits
1 commits
Python
100.0%