Large-scale Multi-modality Models Evaluation Suite

Accelerating the development of large-scale multi-modality models (LMMs) with lmms-eval

🏠 Homepage | 📚 Documentation | 🤗 Huggingface Datasets

This Dataset

This is a formatted version of MM-Vet. It is used in our lmms-eval pipeline to allow for one-click evaluations of large multi-modality models.

@misc{yu2023mmvet,
      title={MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities}, 
      author={Weihao Yu and Zhengyuan Yang and Linjie Li and Jianfeng Wang and Kevin Lin and Zicheng Liu and Xinchao Wang and Lijuan Wang},
      year={2023},
      eprint={2308.02490},
      archivePrefix={arXiv},
      primaryClass={cs.AI}
}