R1-Onevision-Bench

[📂 GitHub][📝 Paper] [🤗 HF Dataset] [🤗 HF Model] [🤗 HF Demo]

Dataset Overview

R1-Onevision-Bench comprises 38 subcategories organized into 5 major domains, including Math, Biology, Chemistry, Physics, Deducation. Additionally, the tasks are categorized into five levels of difficulty, ranging from ‘Junior High School’ to ‘Social Test’ challenges, ensuring a comprehensive evaluation of model capabilities across varying complexities.

Data Format

Reasoning problems are stored in TSV format, with each row containing the following fields:

• index: data id
• question: visual reasoning question
• answer: ground truth answer
• category: question category
• image: base64
• choices: available answer choices
• level: question difficulty level

Benchmark Distribution

Benchmark Samples

Institution

• Zhejiang University

Benchmark Contact

• yang-yi@zju.edu.cn
• xiaoxuanhe@zju.edu.cn
• panhongkun@zju.edu.cn