DreamX-World: A General-Purpose Interactive World Model
See the code
DreamX Team
DreamX-World is a general-purpose world model for interactive world simulation. It generates diverse, high-fidelity worlds that users can explore, control, and transform with event prompts.
The model is trained with a scalable data engine on Unreal Engine data, gameplay footage, and real-world videos, combined with camera estimation and strict data filtering to learn realistic dynamics and interactions. It follows a progressive training pipeline: learning fine-grained action control first, then open-ended event response, and using Reinforcement Learning to improve action following, interaction consistency, and visual fidelity. Finally, through forcing and distillation, DreamX-World achieves efficient inference, making interactive generation practical at scale.
pip install -r requirements.txt
Please check out inference_README.md for detailed instructions.
| Model | Download Link | Details | Instrutions |
|---|---|---|---|
| DreamX-World-5B-Cam | Huggingface, ModelScope | Bidrectional, Supports 5s Video Generation | inference_README.md |
| DreamX-World-5B | Huggingface, ModelScope | Autoregressive, Supports Long-horizon Video Generation | inference_README.md |
The inference time (shown in the
Costcolumn below) comprises both denoising and VAE decoding time.
| Model | GPUs | Video | Cost (Time in second/Peak Memory) |
|---|---|---|---|
| DreamX-World-5B-Cam | 1xH20 | 5s 720P | 509s/38G |
| DreamX-World-5B | 1xH20 | 5s 720P | 26s/40G |
| DreamX-World-5B | 1xH20 | 60s 720P | 342s/72G |
Note: The demo videos are intentionally compressed to ensure smooth playback, which may result in a slight loss of visual quality.
DreamX-World supports long-horizon autoregressive generation with precise camera control. Progressive training on long rollouts mitigates identity, background, style, and color drift, enabling coherent world exploration over hundreds of frames.
DreamX-World uses geometry-guided memory retrieval to recover non-local visual evidence from earlier observations. This improves scene persistence when the camera revisits a previously explored region, preserving its layout, object identities, and local appearance.
DreamX-World enables high-fidelity, controllable exploration across diverse realistic environments, including indoor, urban, natural, and architectural scenes.
Beyond realistic scenes, DreamX-World also generates fantasy, game-like, sci-fi, and stylized worlds.
DreamX-World supports both first-person interaction and coherent third-person generation. It keeps camera-follow behavior stable while preserving controllable agent motion and scene consistency.
DreamX-World supports prompt-driven world events that dynamically change the environment, including flexible and compositional event generation with consistent temporal evolution.
Join our WeChat group for discussion:
If you find DreamX-World useful in your research, please consider citing our technical report:
@article{team2026dreamx,
title={DreamX-World 1.0: A General-Purpose Interactive World Model},
author={Team, DreamX and Bai, Yancheng and Chen, Rui and Chu, Xiangxiang and Dang, Rujing and Dou, Hao and Gao, Bingjie and Gu, Qiwen and Hong, Siyu and Lei, Jiachen and others},
journal={arXiv preprint arXiv:2606.16993},
year={2026}
}
This project is licensed under Apache 2.0. See LICENSE for details.
We thank the Wan Team for open-sourcing their code and models.
41 commits
7 commits
Python
99.0%
Shell
1.0%
DreamX-World: A General-Purpose Interactive World Model
See the code
DreamX Team
DreamX-World is a general-purpose world model for interactive world simulation. It generates diverse, high-fidelity worlds that users can explore, control, and transform with event prompts.
The model is trained with a scalable data engine on Unreal Engine data, gameplay footage, and real-world videos, combined with camera estimation and strict data filtering to learn realistic dynamics and interactions. It follows a progressive training pipeline: learning fine-grained action control first, then open-ended event response, and using Reinforcement Learning to improve action following, interaction consistency, and visual fidelity. Finally, through forcing and distillation, DreamX-World achieves efficient inference, making interactive generation practical at scale.
pip install -r requirements.txt
Please check out inference_README.md for detailed instructions.
| Model | Download Link | Details | Instrutions |
|---|---|---|---|
| DreamX-World-5B-Cam | Huggingface, ModelScope | Bidrectional, Supports 5s Video Generation | inference_README.md |
| DreamX-World-5B | Huggingface, ModelScope | Autoregressive, Supports Long-horizon Video Generation | inference_README.md |
The inference time (shown in the
Costcolumn below) comprises both denoising and VAE decoding time.
| Model | GPUs | Video | Cost (Time in second/Peak Memory) |
|---|---|---|---|
| DreamX-World-5B-Cam | 1xH20 | 5s 720P | 509s/38G |
| DreamX-World-5B | 1xH20 | 5s 720P | 26s/40G |
| DreamX-World-5B | 1xH20 | 60s 720P | 342s/72G |
Note: The demo videos are intentionally compressed to ensure smooth playback, which may result in a slight loss of visual quality.
DreamX-World supports long-horizon autoregressive generation with precise camera control. Progressive training on long rollouts mitigates identity, background, style, and color drift, enabling coherent world exploration over hundreds of frames.
DreamX-World uses geometry-guided memory retrieval to recover non-local visual evidence from earlier observations. This improves scene persistence when the camera revisits a previously explored region, preserving its layout, object identities, and local appearance.
DreamX-World enables high-fidelity, controllable exploration across diverse realistic environments, including indoor, urban, natural, and architectural scenes.
Beyond realistic scenes, DreamX-World also generates fantasy, game-like, sci-fi, and stylized worlds.
DreamX-World supports both first-person interaction and coherent third-person generation. It keeps camera-follow behavior stable while preserving controllable agent motion and scene consistency.
DreamX-World supports prompt-driven world events that dynamically change the environment, including flexible and compositional event generation with consistent temporal evolution.
Join our WeChat group for discussion:
If you find DreamX-World useful in your research, please consider citing our technical report:
@article{team2026dreamx,
title={DreamX-World 1.0: A General-Purpose Interactive World Model},
author={Team, DreamX and Bai, Yancheng and Chen, Rui and Chu, Xiangxiang and Dang, Rujing and Dou, Hao and Gao, Bingjie and Gu, Qiwen and Hong, Siyu and Lei, Jiachen and others},
journal={arXiv preprint arXiv:2606.16993},
year={2026}
}
This project is licensed under Apache 2.0. See LICENSE for details.
We thank the Wan Team for open-sourcing their code and models.
41 commits
7 commits
Python
99.0%
Shell
1.0%