Dataset Description

This dataset is the In-domain part of the training set of VisRAG it includes 122,752 Query-Document (Q-D) Pairs from openly available academic datasets. Our training data is organized with a batch size of 128, ensuring that all data within the same batch comes from the same dataset.

Load the dataset

from datasets import load_dataset
ds = load_dataset("openbmb/VisRAG-Ret-Train-In-domain-data", split="train")