MLLMGuard

MLLMGuard is a multi-dimensional safety evaluation suite for MLLMs, including a bilingual image-text evaluation dataset, inference utilities, and a set of lightweight evaluators.

Quick Links

arXiv Paper

Github Repository

Acquisition of Datasets

The datasets corresponding to the results in the paper are unmasked versions. You can obtain the datasets by filtering out the form. The review results will be sent to your email within 1-2 business days.