VideoMind Datasets

This repository provides the videos and annotations of VideoMind-SFT and downstream evaluation benchmarks. All the videos are provided in both original files and compressed versions (3 FPS, 480p, no audio). A complete list of the datasets is as follows. Please download the sub-directories accordingly if you only need part of the data.

VideoMind-SFT (481K)

Grounder (210K):

Verifier (232K):

Planner (39K):

Benchmarks

The following datasets are not used in our project (partially used during early exploration), but we still share them to facilitate future research.

Notes:

1. For some datasets (e.g., ReXTime), the annotations and videos are stored in different folders. All the directories in Directory need to be downloaded.
2. Use the following commands to concatenate and extract video tar splits (e.g., videos.tar.gz.00, videos_3fps_480_noaudio.tar.gz.00).

# videos.tar.gz.00, videos.tar.gz.01
cat videos.tar.gz.* | tar -zxvf -

# videos_3fps_480_noaudio.tar.gz.00, videos_3fps_480_noaudio.tar.gz.01
cat videos_3fps_480_noaudio.tar.gz.* | tar -zxvf -

📖 Citation

Please kindly cite our paper if you find this project helpful.

@inproceedings{liu2026videomind,
  title={VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning},
  author={Liu, Ye and Lin, Kevin Qinghong and Chen, Chang Wen and Shou, Mike Zheng},
  booktitle={International Conference on Learning Representations (ICLR)},
  year={2026}
}