mtgv/MobileVLM_V2-1.7B

Model

33

stars

6

commits

6

repos using this model

2

linked in READMEs

Feb 7, 2024

updated

endpoints_compatible
mobilevlm
MobileVLM V2
pytorch
text-generation
transformers
Browse cluster: Mobile Vision-Language Models

README

Model Summery

MobileVLM V2 is a family of significantly improved vision language models upon MobileVLM, which proves that a delicate orchestration of novel architectural design, an improved training scheme tailored for mobile VLMs, and rich high-quality dataset curation can substantially benefit VLMs’ performance. Specifically, MobileVLM V2 1.7B achieves better or on-par performance on standard VLM benchmarks compared with much larger VLMs at the 3B scale. Notably, MobileVLM_V2-3B model outperforms a large variety of VLMs at the 7B+ scale.

The MobileVLM_V2-1.7B was built on our MobileLLaMA-1.4B-Chat to facilitate the off-the-shelf deployment.

Model Sources

How to Get Started with the Model

Inference examples can be found at Github.

Contributors

mtgv

6 commits

mtgv/MobileVLM_V2-1.7B

Model

33

stars

6

commits

6

repos using this model

2

linked in READMEs

Feb 7, 2024

updated

endpoints_compatible
mobilevlm
MobileVLM V2
pytorch
text-generation
transformers
Browse cluster: Mobile Vision-Language Models

README

Model Summery

MobileVLM V2 is a family of significantly improved vision language models upon MobileVLM, which proves that a delicate orchestration of novel architectural design, an improved training scheme tailored for mobile VLMs, and rich high-quality dataset curation can substantially benefit VLMs’ performance. Specifically, MobileVLM V2 1.7B achieves better or on-par performance on standard VLM benchmarks compared with much larger VLMs at the 3B scale. Notably, MobileVLM_V2-3B model outperforms a large variety of VLMs at the 7B+ scale.

The MobileVLM_V2-1.7B was built on our MobileLLaMA-1.4B-Chat to facilitate the off-the-shelf deployment.

Model Sources

How to Get Started with the Model

Inference examples can be found at Github.

Contributors

mtgv

6 commits