EvalCrafter Text-to-Video (ECTV) Dataset 🎥📊

Code · Project Page · Huggingface Leaderboard · Paper@ArXiv · Prompt list

Welcome to the ECTV dataset! This repository contains around 10000 videos generated by various methods using the Prompt list. These videos have been evaluated using the innovative EvalCrafter framework, which assesses generative models across visual, content, and motion qualities using 17 objective metrics and subjective user opinions.

Dataset Details 📚

• Paper: Read the Paper
• Code: Code
• Prompt List (700 prompts): Prompt list
• Hugging Face Leaderboard: Huggingface Leaderboard
• Project Page: Project Page
• Methods Included in ECTV dataset:
  • VideoCrafter2
  • VideoCrafter1
  • VideoCrafter0.9 (Floor33)
  • Gen2-2023.12
  • Gen2-2023.09
  • PikaLab V1.0
  • PikaLab
  • Hotshot-XL
  • Show-1
  • Modelscope-XL
  • Zeroscope
  • Lavie
  • MoonValley
• Dataset Structure: Generate videos are organized in the following structure (take videocrafter-v1.0 for an example)

  ./videocrafter-v1.0.tar.gz/videocrafter-v1.0/
  ├── 0000.mp4
  ├── 0001.mp4
  ├── 0002.mp4
  ├── 0003.mp4
  ├── 0004.mp4
  ...
  └── 0699.mp4
  

Acknowledgements and Citation 🙏

This dataset is based on the EvalCrafter framework, which utilizes various open-source repositories for video generation evaluation. If you find this dataset helpful, please consider citing the original work:

@article{liu2023evalcrafter,
  title={Evalcrafter: Benchmarking and evaluating large video generation models},
  author={Liu, Yaofang and Cun, Xiaodong and Liu, Xuebo and Wang, Xintao and Zhang, Yong and Chen, Haoxin and Liu, Yang and Zeng, Tieyong and Chan, Raymond and Shan, Ying},
  journal={arXiv preprint arXiv:2310.11440},
  year={2023}
}

Explore More About Video Generation:

• VideoCrafter1: Open Diffusion Models for High-Quality Video Generation
• VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models