wentao-yuan/where2place

Dataset

2

stars

3

commits

1

linked in READMEs

Sep 22, 2024

updated

README

Where2Place Dataset Card

Dataset Details

This dataset contains 100 real-world images to evaluate free space reference using spatial relations. The images are collected from various cluttered environments. Each image is labeled with a sentence describing the desired some free space and a mask of the desired region.

Dataset Structure

  • images folder
    • Contains the raw images;
  • masks folder
    • Contains the corresponding binary masks for each image;
  • point_questions.jsonl
    • Contains a list of questions asking for a set of points within the desired regions;
  • bbox_questions.jsonl
    • Contains the same questions as point_questions.jsonl;
    • The goal here is to output a bounding box instead of points.

Resources for More Information

Citation

If you find our work helpful, please consider citing our paper.

@article{yuan2024robopoint,
  title={RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics},
  author={Yuan, Wentao and Duan, Jiafei and Blukis, Valts and Pumacay, Wilbert and Krishna, Ranjay and Murali, Adithyavairavan and Mousavian, Arsalan and Fox, Dieter},
  journal={arXiv preprint arXiv:2406.10721},
  year={2024}
}

Contributors

wentao-yuan

3 commits

wentao-yuan/where2place

Dataset

2

stars

3

commits

1

linked in READMEs

Sep 22, 2024

updated

README

Where2Place Dataset Card

Dataset Details

This dataset contains 100 real-world images to evaluate free space reference using spatial relations. The images are collected from various cluttered environments. Each image is labeled with a sentence describing the desired some free space and a mask of the desired region.

Dataset Structure

  • images folder
    • Contains the raw images;
  • masks folder
    • Contains the corresponding binary masks for each image;
  • point_questions.jsonl
    • Contains a list of questions asking for a set of points within the desired regions;
  • bbox_questions.jsonl
    • Contains the same questions as point_questions.jsonl;
    • The goal here is to output a bounding box instead of points.

Resources for More Information

Citation

If you find our work helpful, please consider citing our paper.

@article{yuan2024robopoint,
  title={RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics},
  author={Yuan, Wentao and Duan, Jiafei and Blukis, Valts and Pumacay, Wilbert and Krishna, Ranjay and Murali, Adithyavairavan and Mousavian, Arsalan and Fox, Dieter},
  journal={arXiv preprint arXiv:2406.10721},
  year={2024}
}

Contributors

wentao-yuan

3 commits