OpenGVLab/VisionLLM

VisionLLM Series

1,154

stars

commits

Python

primary language

Feb 27, 2025

updated

arxiv.org/abs/2305.11175

generalist-model

large-language-models

object-detection

README

VisionLLM Series

VisionLLM: Large Language Model as Open-Ended Decoder for Vision-Centric Tasks (NIPS2023)
VisionLLM v2: A Generalist Multimodal Large Language Model for Hundeds of Vision-Language Tasks (NIPS2024)

🚀 News

2024/06: We release VisionLLM v2, which is a generalist multimodal large language model to support hundres of vision-language tasks, covering visual understanding, perception and generation.

Contributors

wjn922

19 commits

czczup

9 commits

liu-zhy

5 commits

Similar repos

EvolvingLMMs-Lab/NEO

NEO Series: Native Vision-Language Models from First Principles

890

NVlabs/Eagle

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

3,540

zeinhasan/Vision-Language-Model-Image-to-Text-Generation

Vision Language Model - Image to Text Generation

OpenGVLab/all-seeing

[ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding…

506

same org

muna-ai/models

Popular LLMs and other models compiled with Muna.

shared topics

GSAI-ML/LLaDA-V

Model

BradyFU/Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

18,006

zai-org/GLM-V

GLM-4.6V/4.5V/4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement…

2,380

Languages

Python

72.1%

C++

15.4%

Cuda

12.0%

README

VisionLLM Series

VisionLLM: Large Language Model as Open-Ended Decoder for Vision-Centric Tasks (NIPS2023)
VisionLLM v2: A Generalist Multimodal Large Language Model for Hundeds of Vision-Language Tasks (NIPS2024)

🚀 News

2024/06: We release VisionLLM v2, which is a generalist multimodal large language model to support hundres of vision-language tasks, covering visual understanding, perception and generation.