‌Tencent XR 3DGen Suite: Integrated Framework for High-Quality 3D Shape Generation, Texture Synthesis, and Character Customization

Overview

This is an all-in-one code release for 3D generation pipeline developed by Tencent XR Vision Labs. It contains following submodules, including training and inference codes:

PandoraX
├── geometry
│   ├── main_pipeline
│   │   ├── vae             (geometry_vae)
│   │   └── diffusion       (geometry_dit)
│   ├── am_generation       (ArtistCreatedMeshes)
│   ├── neusdfusion         (NeuSDFusion_release)
│   └── isosurface          (sparse_mc)
├── texture
│   ├── main_pipeline       (texture_generation)
│   ├── geo2rgb             (multiview_geo2rgb)
│   ├── rgb2pbr             (multiview_rgbpbr)
│   └── render_bake         (render-bake_utilities)
├── data
│   ├── main_data_pipeline  (data_preparation)
│   └── openvdb_interface   (python-openvdb)
├── character
│   ├── main                (character_generation)
│   └── phy_cage            (PhyCAGE_release)
├── misc
│   ├── raft_stereo         (RAFT-Stereo_training)
│   ├── vs_tool             (VSTool)
│   ├── quad_remesh         (quad_remesh_utils)
│   └── texture_utils       (frontal_image_generation_4_texture_gen)

Dependencies

dependencies for submodules are zipped under requirements_txt.zip

Model weights

model weights and tech report can be downloaded from https://drive.google.com/drive/folders/1NgtWeouNiM-G5VtZMQRF10f2ymNzLsdn

Inference

1. After downloading the weights, please update the "pretrained_weights_path" in ./geometry/main_pipeline/diffusion/utils/rmbg1_4.py and ./texture/tex_refine/sam_preprocess/run_sam.py

2. python test_inference.py --image_path path of the input image --save_dir path of the save dir --weights_path path of the pretrained weights

Citation

@article{yang2025pandora3d,

title={Pandora3D: A Comprehensive Framework for High-Quality 3D Shape and Texture Generation},

author={Yang, Jiayu and Shang, Taizhang and Sun, Weixuan and Song, Xibin and Chen, Ziang and Wang, Senbo and Chen, Shenzhou and Liu, Weizhe and Li, Hongdong and Ji, Pan},

journal={arXiv preprint arXiv:2502.14247},

year={2025}

}

License

Tencent XR 3DGen is licensed under the MIT License but with additional restrictions in accordance with company policies. These include prohibitions on using the software for harmful or discriminatory purposes, or within the European Union. Please refer to the LICENSE file for full details on the terms and conditions.