Disclaimer: This dataset is organized and adapted from embodiedreasoning/ERQA. The original data was provided in TFRecord format and has been converted here into a more accessible and easy-to-use format.
This evaluation benchmark covers a variety of topics related to spatial reasoning and world knowledge focused on real-world scenarios, particularly in the context of robotics. Please find more details and visualizations in the tech report.
| Field Name | Type | Description |
|---|---|---|
| question_id | string | Unique question ID |
| question | string | Question text |
| question_type | string | Type of question |
| answer | string | Answer |
| visual_indices | list[int] | List of visual indices |
| images | list[Image] | Image data |
| images_base64 | list[string] | Image data in base64 |
4 commits
Disclaimer: This dataset is organized and adapted from embodiedreasoning/ERQA. The original data was provided in TFRecord format and has been converted here into a more accessible and easy-to-use format.
This evaluation benchmark covers a variety of topics related to spatial reasoning and world knowledge focused on real-world scenarios, particularly in the context of robotics. Please find more details and visualizations in the tech report.
| Field Name | Type | Description |
|---|---|---|
| question_id | string | Unique question ID |
| question | string | Question text |
| question_type | string | Type of question |
| answer | string | Answer |
| visual_indices | list[int] | List of visual indices |
| images | list[Image] | Image data |
| images_base64 | list[string] | Image data in base64 |
4 commits