📌 This is the official repository for the dataset presented in:
Weave: A Benchmark for Evaluating Multimodal Editing Models
WEAVE consists of two main components:
data/ folder in parquet formattest/ folder in both zip and json formats
WEAVE-100k is generated through four sophisticated pipelines and multiple validation stages using state-of-the-art VLMs and image generation models:
WEAVEBench is manually designed and curated, featuring 16 diverse categories of editing tasks.
test.json)⚠️ Note:
Image #1references the first image, starting from 1. This represents the image index, not the conversation turn. It corresponds to the first image in theimagesarray (images[0]).When using multi-turn conversations, each number index should be replaced once with
Image #{idx}<image>\n. For single-turn, simply replace directly.
{
"domain": "string",
"images": [],
"chats": []
}
Please refer to our code repository:
@article{weave2024,
title={Weave: A Benchmark for Evaluating Multimodal Editing Models},
author={Wei Chow et al.},
journal={arXiv preprint arXiv:2511.15738},
year={2024}
}
500 commits
📌 This is the official repository for the dataset presented in:
Weave: A Benchmark for Evaluating Multimodal Editing Models
WEAVE consists of two main components:
data/ folder in parquet formattest/ folder in both zip and json formats
WEAVE-100k is generated through four sophisticated pipelines and multiple validation stages using state-of-the-art VLMs and image generation models:
WEAVEBench is manually designed and curated, featuring 16 diverse categories of editing tasks.
test.json)⚠️ Note:
Image #1references the first image, starting from 1. This represents the image index, not the conversation turn. It corresponds to the first image in theimagesarray (images[0]).When using multi-turn conversations, each number index should be replaced once with
Image #{idx}<image>\n. For single-turn, simply replace directly.
{
"domain": "string",
"images": [],
"chats": []
}
Please refer to our code repository:
@article{weave2024,
title={Weave: A Benchmark for Evaluating Multimodal Editing Models},
author={Wei Chow et al.},
journal={arXiv preprint arXiv:2511.15738},
year={2024}
}
500 commits