This repo contains the dataset proposed in

Sekai: A Video Dataset towards World Exploration

Zhen Li, Chuanhao Li, Xiaofeng Mao, Shaoheng Lin, Ming Li, Shitian Zhao, Zhaopan Xu, Xinyue Li, Yukang Feng, Jianwen Sun, Zizhen Li, Fanrui Zhang, Jiaxin Ai, Zhixiang Wang, Yuwei Wu, Tong He, Jiangmiao Pang, Yu Qiao, Yunde Jia, Kaipeng Zhang

Shanghai AI Laboratory, Beijing Institute of Technology

🧠 Introduction

TL;DR We present Sekai (せかい, “world” in Japanese), a high-quality egocentric video dataset for immersive world exploration and generation. Sekai includes over 5000 hours of YouTube videos and game footage with rich annotations. It features:

• 📹 Diverse, high-resolution videos (720p)
• 🌍 Coverage of 100+ countries and 750+ cities
• 🚶‍♂️ First-person and 🛸 drone perspectives
• 🕒 Long sequences (≥ 60s) for real-world continuity
• 🏷️ Detailed annotations: location, scene, weather, crowd, captions, and camera trajectories

🚀 Quick Start

Please refer to our Github Repo.

📖 Citation

If you find this project helpful, please consider citing:

@article{li2025sekai,
      title={Sekai: A Video Dataset towards World Exploration}, 
      author={Zhen Li and Chuanhao Li and Xiaofeng Mao and Shaoheng Lin and Ming Li and Shitian Zhao and Zhaopan Xu and Xinyue Li and Yukang Feng and Jianwen Sun and Zizhen Li and Fanrui Zhang and Jiaxin Ai and Zhixiang Wang and Yuwei Wu and Tong He and Jiangmiao Pang and Yu Qiao and Yunde Jia and Kaipeng Zhang},
      journal={arXiv preprint arXiv:2506.15675},
      year={2025}
}