voxel51/papers-with-data

A curated list of papers that released datasets along with their work

Python

126

34 commits

updated Mar 23, 2026

See the code

README

Papers with Data

Discord Hugging Face Voxel51 Blog Newsletter LinkedIn Twitter Medium

Data reigns supreme 🥇

Every day it becomes more evident that data is the limiting factor for state-of-the-art 📈 machine learning. Your model architecture may be revolutionary, but without high-quality data 📊 to train on, it will be doomed to mediocrity.

Pair idea with execution and use top-notch data in your next project!

NeurIPS 2023

We've combed through the 2384 papers accepted to NeurIPS in 2023 and compiled a short-list of papers introducing exciting new datasets.

TitleTagsPaperDatasetCode
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Dataperceptual similarity, image, synthetic, diffusion, JND, 2AFCarXivFiftyOneGitHub
Visual Instruction Tuningvision-language, llm, instruction-tuning, image, multimodalarXivFiftyOneGitHub
ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationreward-model, image, text-to-image, synthetic, human-preference, alignmentarXivFiftyOneGitHub
MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingimage-editing, synthetic, image, instructionarXivFiftyOneGitHub
REAL3D-AD3D, point-cloud, anomaly-detectionarXivFiftyOneGitHub

WACV 2024

TitleTagsPaperDatasetCode
dacl10k: Benchmark for Semantic Bridge Damage Segmentationimage, semantic segmentation, classification, construction, defectarXivFiftyOneGitHub

ICCV 2023

TitleTagsPaperDatasetCode
Satlas: A Large-Scale, Multi-Task Dataset for Remote Sensing Image Understandingimage, SAR, satellite, detection, climatearXivFiftyOneGitHub
Building3D: An Urban-Scale Dataset and Benchmarks for Learning Roof Structures from Point Clouds3D, point cloudarXivFiftyOne
EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understandingimage, object, egoarXivFiftyOneGitHub
Equivariant Similarity for Vision-Language Foundation Modelsimage, similarity, captionarXivFiftyOneGitHub
MOSE: A New Dataset for Video Object Segmentation in Complex Scenesvideo, segmentation, trackingarXivFiftyOne
SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenesmulti-object tracking, sportsarXivFiftyOneGitHub

CVPR 2023

cvpr2023-4

We've combed through the 2359 papers accepted to CVPR in 2023 and compiled a short-list of papers introducing exciting new datasets.

TitleTagsPaperDatasetCode
MVImgNet: A Large-scale Dataset of Multi-view Imagesmulti-view, imagearXivFiftyOneGitHub
GeoNet: Benchmarking Unsupervised Adaptation across Geographiesgeolocation, imagearXivFiftyOne
Joint HDR Denoising and Fusion: A Real-World Mobile HDR Image Datasetdenoising, imageFiftyOneGitHub
Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereooptical flow, stereo, imagearXivFiftyOne
ImageNet-E: Benchmarking Neural Network Robustness via Attribute Editingimage, editingarXivFiftyOneGitHub
ARKitTrack: A New Diverse Dataset for Tracking Using Mobile RGB-D DataRGB-D, segmentation, videoarXivFiftyOneGitHub
Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identificationlow-light, cross-modal, IRarXivFiftyOneGitHub
JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingpose estimation, image, keypoint, trackingarXivFiftyOne
A New Benchmark: On the Utility of Synthetic Data with Blender for Bare Supervised Learning and Downstream Domain Adaptationsynthetic, domain adaptation, supervisedarXivFiftyOneGitHub

Papers from 2022

TitleTagsPaperDatasetCode
Calving fronts and where to find them: a benchmark dataset and methodology for automatic glacier calving front extraction from synthetic aperture radar imageryglacier, climate, SAR, satellite, image, semantic segmentationPaper BadgeFiftyOneCode Badge
The Caltech Fish Counting Dataset: A Benchmark for Multiple-Object Tracking and Countingconservation, detection, SONAR, video, tracking, countingarXivFiftyOneGitHub

Classics

TitleTagsPaperDatasetCode
ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasesx-ray, image, healthcare, detectionarXivFiftyOne

Contributing 👋

We would love your help in making this repository even better! If we missed a paper that introduced a new dataset, or if you can think of any ways to improve the repository, feel free to open an issue or a pull request.

Note

This repository is inspired by paperswithcode, and the template was adapted from top-cvpr-2023-papers.

ai
artificial-intelligence
computer-vision
data-science
datasets
deep-learning
machine-learning
papers

Contributors

jacobmarks

28 commits

brimoor

4 commits

Burhan-Q

1 commits

nicklotz

1 commits

voxel51/papers-with-data

A curated list of papers that released datasets along with their work

Python

126

34 commits

updated Mar 23, 2026

See the code

README

Papers with Data

Discord Hugging Face Voxel51 Blog Newsletter LinkedIn Twitter Medium

Data reigns supreme 🥇

Every day it becomes more evident that data is the limiting factor for state-of-the-art 📈 machine learning. Your model architecture may be revolutionary, but without high-quality data 📊 to train on, it will be doomed to mediocrity.

Pair idea with execution and use top-notch data in your next project!

NeurIPS 2023

We've combed through the 2384 papers accepted to NeurIPS in 2023 and compiled a short-list of papers introducing exciting new datasets.

TitleTagsPaperDatasetCode
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Dataperceptual similarity, image, synthetic, diffusion, JND, 2AFCarXivFiftyOneGitHub
Visual Instruction Tuningvision-language, llm, instruction-tuning, image, multimodalarXivFiftyOneGitHub
ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationreward-model, image, text-to-image, synthetic, human-preference, alignmentarXivFiftyOneGitHub
MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingimage-editing, synthetic, image, instructionarXivFiftyOneGitHub
REAL3D-AD3D, point-cloud, anomaly-detectionarXivFiftyOneGitHub

WACV 2024

TitleTagsPaperDatasetCode
dacl10k: Benchmark for Semantic Bridge Damage Segmentationimage, semantic segmentation, classification, construction, defectarXivFiftyOneGitHub

ICCV 2023

TitleTagsPaperDatasetCode
Satlas: A Large-Scale, Multi-Task Dataset for Remote Sensing Image Understandingimage, SAR, satellite, detection, climatearXivFiftyOneGitHub
Building3D: An Urban-Scale Dataset and Benchmarks for Learning Roof Structures from Point Clouds3D, point cloudarXivFiftyOne
EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understandingimage, object, egoarXivFiftyOneGitHub
Equivariant Similarity for Vision-Language Foundation Modelsimage, similarity, captionarXivFiftyOneGitHub
MOSE: A New Dataset for Video Object Segmentation in Complex Scenesvideo, segmentation, trackingarXivFiftyOne
SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenesmulti-object tracking, sportsarXivFiftyOneGitHub

CVPR 2023

cvpr2023-4

We've combed through the 2359 papers accepted to CVPR in 2023 and compiled a short-list of papers introducing exciting new datasets.

TitleTagsPaperDatasetCode
MVImgNet: A Large-scale Dataset of Multi-view Imagesmulti-view, imagearXivFiftyOneGitHub
GeoNet: Benchmarking Unsupervised Adaptation across Geographiesgeolocation, imagearXivFiftyOne
Joint HDR Denoising and Fusion: A Real-World Mobile HDR Image Datasetdenoising, imageFiftyOneGitHub
Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereooptical flow, stereo, imagearXivFiftyOne
ImageNet-E: Benchmarking Neural Network Robustness via Attribute Editingimage, editingarXivFiftyOneGitHub
ARKitTrack: A New Diverse Dataset for Tracking Using Mobile RGB-D DataRGB-D, segmentation, videoarXivFiftyOneGitHub
Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identificationlow-light, cross-modal, IRarXivFiftyOneGitHub
JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingpose estimation, image, keypoint, trackingarXivFiftyOne
A New Benchmark: On the Utility of Synthetic Data with Blender for Bare Supervised Learning and Downstream Domain Adaptationsynthetic, domain adaptation, supervisedarXivFiftyOneGitHub

Papers from 2022

TitleTagsPaperDatasetCode
Calving fronts and where to find them: a benchmark dataset and methodology for automatic glacier calving front extraction from synthetic aperture radar imageryglacier, climate, SAR, satellite, image, semantic segmentationPaper BadgeFiftyOneCode Badge
The Caltech Fish Counting Dataset: A Benchmark for Multiple-Object Tracking and Countingconservation, detection, SONAR, video, tracking, countingarXivFiftyOneGitHub

Classics

TitleTagsPaperDatasetCode
ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasesx-ray, image, healthcare, detectionarXivFiftyOne

Contributing 👋

We would love your help in making this repository even better! If we missed a paper that introduced a new dataset, or if you can think of any ways to improve the repository, feel free to open an issue or a pull request.

Note

This repository is inspired by paperswithcode, and the template was adapted from top-cvpr-2023-papers.

ai
artificial-intelligence
computer-vision
data-science
datasets
deep-learning
machine-learning
papers

Contributors

jacobmarks

28 commits

brimoor

4 commits

Burhan-Q

1 commits

nicklotz

1 commits

Languages

Python

100.0%