pipixin321/Awesome-Video-MLLMs

:fire: :fire: :fire: Awesome MLLMs/Benchmarks for Short/Long/Streaming Video Understanding :video_camera:

15 commits

updated Sep 1, 2025

See the code

README

Awesome-Video-Multimodal-Large-Language-Models

🔥🔥🔥 Awesome MLLMs/Benchmarks for Short/Long/Streaming Video Understanding

General Works

Title	Venue	Date	Code	Frames/FPS
InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency	arXiv	2025-08	Github	-
MiniCPM-V 4.5: A GPT-4o Level MLLM for Single Image, Multi Image and Video Understanding on Your Phone	-	2025-08	Github	10fps
GLM-4.5V	Zhipu AI	2025-08	API	-
Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities	Google	2025-06	-	-
ERNIE 4.5	Baidu	2025-06	Github	-
Seed1.5-VL Technical Report	arXiv	2025-05	-	-
An LMM for Efficient Video Understanding via Reinforced Compression of Video Cubes	arXiv	2025-04	Github	-
InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models	arXiv	2025-04	Github	-
Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuray	arXiv	2025-02	Github	-
Qwen2.5-VL Technical Report	arXiv	2025-02	Github	-
Apollo: An Exploration of Video Understanding in Large Multimodal Models	arXiv	2024-12	-	-
TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability	arXiv	2024-11	Github	128
ARIA : An Open Multimodal Native Mixture-of-Experts Model	arXiv	2024-10	Github	256
Qwen2-VL: Enhancing Vision-Language Model’s Perception of the World at Any Resolution	arXiv	2024-10	Github	768(2fps)
LLaVA-Video: Video Instruction Tuning With Synthetic Data	arXiv	2024-10	Github	64
LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding	arXiv	2024-10	Github	1FPS
MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone	arXiv	2023-08	Github	64
mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models	arXiv	2024-08	Github	128
InternVL2: Better than the Best—Expanding Performance Boundaries of Open-Source Multimodal Models with the Progressive Scaling Strategy	blog	2024-07	Github	16
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs	arXiv	2024-06	Github	32
ShareGPT4Video: Improving video understanding and generation with better captions	arXiv	2024-06	Github	16
LongVA: Long context transfer from language to vision	arXiv	2024-06	Github	1FPS
LongVLM: Efficient long video understanding via large language models	ECCV	2024-04	Github	100
VILA: On Pre-training for Visual Language Models	CVPR	2023-12	Github	8
TimeChat: A time-sensitive multimodal large language model for long video understanding	CVPR	2023-12	Github	96
Chat-UniVi unified visual representation empowers large language models with image and video understanding	CVPR	2023-11	Github	64
VTimeLLM: Empower LLM to Grasp Video Moments	CVPR	2023-11	Github	100
LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models	ECCV	2023-11	Github	1FPS
Video-LLaVA: Learning united visual representation by alignment before projection	arXiv	2023-11	Github	8
MovieChat: From Dense Token to Sparse Memory for Long Video Understanding	arXiv	2023-07	Github	2048
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models	ACL	2023-06	Github	100
VALLEY: Video Assistant with Large Language model Enhanced ability	arXiv	2023-06	Github	0.5FPS
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding	EMNLP	2023-06	Github	8
VideoChat: Chat-Centric Video Understanding	arXiv	2023-05	Github	4~32
LLaMA-Adapter: Efficient Fine-tuning of LLaMA	ICLR	2023-03	Github	-

Streaming Videos

Title	Venue	Date	Code	Frames
[Benchmark] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?	arXiv	2025-01	Github	Streaming
Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction	arXiv	2025-01	Github	Streaming
VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction	arXiv	2025-01	Github	Streaming
Streaming long video understanding with large language models	arXiv	2024-05	-	16(Streaming)

Interesting Works

Title	Venue	Date	Code	Frames
Sparrow: Data-Efficient Video-LLM with Text-to-Image Augmentation	arXiv	2025-03	Github	-
T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs	arXiv	2024-12	Github	-

Benchmarks for Evaluation

General

:bar_chart: Opencomprass Leaderboard

Title	Venue	Date	Repo	LeaderBoard
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark	-	2023-12	Github	-
TempCompass: Do Video LLMs Really Understand Videos?	ACL	2024-03	Github	-
Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis	-	2024-06	Github	-
MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding	NIPS D&B	2024-06	Github	-
MLVU: A Comprehensive Benchmark for Multi-Task Long Video Understanding	arXiv	2024-06	Github	-
HourVideo: 1-Hour Video-Language Understanding	NIPS D&B	2024-11	Github	comming soon

awesome-list

benchmarks

large-language-models

mllm

multimodal-instruction-tuning

multimodal-video-understanding

video-understanding

Contributors

pipixin321

15 commits

Similar repos

kimberlyii/Awesome-Video-Understanding

yunlong10/Awesome-LLMs-for-Video-Understanding

🔥🔥🔥 [IEEE TCSVT] Latest Papers, Codes and Datasets on Vid-LLMs.

3,290

BradyFU/Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

18,040

marinero4972/Awesome-HumanView-VideoUnderstanding

[survey] Watch, Remember, Reason: Human-View Video Understanding with MLLMs

nguyentthong/video-language-understanding

[ACL’24 Findings] Video-Language Understanding: A Survey from Model Architecture, Model Training,…

JUNJIE99/MLVU

🔥🔥MLVU: Multi-task Long Video Understanding Benchmark

269

rese1f/MovieChat

[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

707

wenhaochai/MovieChat

[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

707

pipixin321/Awesome-Video-MLLMs

:fire: :fire: :fire: Awesome MLLMs/Benchmarks for Short/Long/Streaming Video Understanding :video_camera:

15 commits

updated Sep 1, 2025

See the code

README