The NuRec-AV-Object-Benchmark is an object-centric benchmark for evaluating image-to-3D reconstruction systems on autonomous vehicle data. Introduced alongside Asset Harvester, it is designed to support systematic evaluation of in-the-wild AV object reconstruction under realistic viewpoint bias and sensor noise.
Unlike curated object datasets with dense coverage, this benchmark reflects the sparse and imperfect observation regime found in real driving logs. Objects are often seen from only one or a few views, with heavy occlusion, motion blur, noisy calibration, rolling-shutter effects, and imperfect geometric alignment.
Each sample is organized under a semantic object category and a sample identifier, and includes object-centric RGB crops, foreground masks, and camera metadata. The benchmark is distributed in two complementary parts:
Part_A: a held-out-view evaluation split with input_views/ and reserved_views/Part_B: a harder no-ground-truth split with input_views/ onlycommercial_vehiclesconsumer_vehiclesother_objectsVRU_pedestriansVRU_ridersPart_A provides input_views/ together with reserved_views/ that are not used as model input. These reserved views act as held-out reference targets for quantitative evaluation.
Each Part_A sample contains:
input_views/reserved_views/frame_XX.jpegmask_XX.pngcamera.jsonPart_B is intentionally more challenging. It contains stronger motion blur, heavier occlusion, and narrower view coverage. No reserved reference views are provided, so this split is intended for harder qualitative or perceptual evaluation settings.
Each Part_B sample contains:
input_views/frame_XX.jpegmask_XX.pngcamera.json3716Part_A: 2206 samplesPart_B: 1510 samplesPart_A
commercial_vehicles: 308consumer_vehicles: 1472other_objects: 55VRU_pedestrians: 330VRU_riders: 41Part_B
commercial_vehicles: 405consumer_vehicles: 602other_objects: 90VRU_pedestrians: 383VRU_riders: 302026-03-254 commits
The NuRec-AV-Object-Benchmark is an object-centric benchmark for evaluating image-to-3D reconstruction systems on autonomous vehicle data. Introduced alongside Asset Harvester, it is designed to support systematic evaluation of in-the-wild AV object reconstruction under realistic viewpoint bias and sensor noise.
Unlike curated object datasets with dense coverage, this benchmark reflects the sparse and imperfect observation regime found in real driving logs. Objects are often seen from only one or a few views, with heavy occlusion, motion blur, noisy calibration, rolling-shutter effects, and imperfect geometric alignment.
Each sample is organized under a semantic object category and a sample identifier, and includes object-centric RGB crops, foreground masks, and camera metadata. The benchmark is distributed in two complementary parts:
Part_A: a held-out-view evaluation split with input_views/ and reserved_views/Part_B: a harder no-ground-truth split with input_views/ onlycommercial_vehiclesconsumer_vehiclesother_objectsVRU_pedestriansVRU_ridersPart_A provides input_views/ together with reserved_views/ that are not used as model input. These reserved views act as held-out reference targets for quantitative evaluation.
Each Part_A sample contains:
input_views/reserved_views/frame_XX.jpegmask_XX.pngcamera.jsonPart_B is intentionally more challenging. It contains stronger motion blur, heavier occlusion, and narrower view coverage. No reserved reference views are provided, so this split is intended for harder qualitative or perceptual evaluation settings.
Each Part_B sample contains:
input_views/frame_XX.jpegmask_XX.pngcamera.json3716Part_A: 2206 samplesPart_B: 1510 samplesPart_A
commercial_vehicles: 308consumer_vehicles: 1472other_objects: 55VRU_pedestrians: 330VRU_riders: 41Part_B
commercial_vehicles: 405consumer_vehicles: 602other_objects: 90VRU_pedestrians: 383VRU_riders: 302026-03-254 commits