MMInstruction/VLFeedback

Dataset

Dataset Card for VLFeedback

51

21 commits

2 linked in READMEs

updated Oct 17, 2024

See the code

README

Dataset Card for VLFeedback

Dataset Summary

VLFeedback is a large-scale vision-language preference dataset, annotated by GPT-4V. It consists of 80k multi-modal instructions from various souces that encompass various capabilities of LVLMs.

fig1

We build a model pool of 12 LVLMs and each data sample contains 4 responses from different models. Each response is annotated in three aspects: helpfulness, visual faithfulness, and ethical considerations. The resulting preference dataset contains more than 380k comparison pairs.

fig2

Citation

@article{2023vlfeedback,
  author      = {Lei Li and Zhihui Xie and Mukai Li and Shunian Chen and Peiyi Wang and Liang Chen and  Yazheng Yang and  Benyou Wang and  Lingpeng Kong},
  title       = {Silkie: Preference Distillation for Large Visual Language Models},
  publisher   = {arXiv:2312.10665},
  year        = {2023}
}

Contributors

TO
tobiaslee

10 commits

goxzh

4 commits

Zhihui

4 commits

leonardPKU

2 commits

MMInstruction/VLFeedback

Dataset

Dataset Card for VLFeedback

51

21 commits

2 linked in READMEs

updated Oct 17, 2024

See the code

README

Dataset Card for VLFeedback

Dataset Summary

VLFeedback is a large-scale vision-language preference dataset, annotated by GPT-4V. It consists of 80k multi-modal instructions from various souces that encompass various capabilities of LVLMs.

fig1

We build a model pool of 12 LVLMs and each data sample contains 4 responses from different models. Each response is annotated in three aspects: helpfulness, visual faithfulness, and ethical considerations. The resulting preference dataset contains more than 380k comparison pairs.

fig2

Citation

@article{2023vlfeedback,
  author      = {Lei Li and Zhihui Xie and Mukai Li and Shunian Chen and Peiyi Wang and Liang Chen and  Yazheng Yang and  Benyou Wang and  Lingpeng Kong},
  title       = {Silkie: Preference Distillation for Large Visual Language Models},
  publisher   = {arXiv:2312.10665},
  year        = {2023}
}

Contributors

TO
tobiaslee

10 commits

goxzh

4 commits

Zhihui

4 commits

leonardPKU

2 commits