Awesome-Physics-Cognition-based-Video-Generation

🚀🚀🚀 This is a repository for organizing papers, codes, and other resources related to physics cognition-based video generation. This repo is being actively updated, please stay tuned! For more detailed information, please refer to our survey paper: Exploring the Evolution of Physics Cognition in Video Generation: A Survey.

This paper list covers T2V, V2V, and dynamic 3D and 4D generation based on physics, and includes some world models and world simulators.

If you find this repository useful, please consider giving us a star 🌟 and a cite.

⚡ Contributing

We welcome feedback, suggestions, and contributions that can help improve this survey and repository and make them valuable resources for the entire community. We will actively maintain this repository by incorporating new research as it emerges. If you have any suggestions about our taxonomy, please take a look at any missed papers, or update any preprint arXiv paper that has been accepted to some venue.

If you want to add your work or model to this list, please do not hesitate to pull requests.

Markdown format:

 * Paper Name. [[Paper]](link) [[Code]](link) [[Website]](link) [**Name of Conference or Journal + Year**]

📖 Table of Contents

• ⚡ Contributing
• 📖 Table of Contents
  • Workshops
  • Surveys
  • Basic Schematic Perception for Generation
  • Passive Cognition of Physical Knowledge for Generation
  • Active Cognition for World Simulation
  • Datasets, Benchmarks and Metrics
  • Physical Understanding
    • VLMs, LLMs, MLLMs on Physical Understanding
    • Benchmarks
• ♥️ Star History
• 📑 Citation

Workshops

Surveys

Basic Schematic Perception for Generation

Passive Cognition of Physical Knowledge for Generation

Active Cognition for World Simulation

Datasets, Benchmarks and Metrics

Physical Understanding

VLMs, LLMs, MLLMs on Physical Understanding

Benchmarks

♥️ Star History

📑 Citation

Please consider citing 📑 our papers if our repository is helpful to your work, thanks sincerely!

@misc{lin2025exploringevolutionphysicscognition,
      title={Exploring the Evolution of Physics Cognition in Video Generation: A Survey}, 
      author={Minghui Lin and Xiang Wang and Yishan Wang and Shu Wang and Fengqi Dai and Pengxiang Ding and Cunxiang Wang and Zhengrong Zuo and Nong Sang and Siteng Huang and Donglin Wang},
      year={2025},
      eprint={2503.21765},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2503.21765}, 
}