alkzar90/NIH-Chest-X-ray-dataset

Dataset

Dataset Card for NIH Chest X-ray dataset

62

92 commits

1 linked in READMEs

updated Sep 11, 2024

See the code

README

Dataset Card for NIH Chest X-ray dataset

Table of Contents

Dataset Description

Dataset Summary

ChestX-ray dataset comprises 112,120 frontal-view X-ray images of 30,805 unique patients with the text-mined fourteen disease image labels (where each image can have multi-labels), mined from the associated radiological reports using natural language processing. Fourteen common thoracic pathologies include Atelectasis, Consolidation, Infiltration, Pneumothorax, Edema, Emphysema, Fibrosis, Effusion, Pneumonia, Pleural_thickening, Cardiomegaly, Nodule, Mass and Hernia, which is an extension of the 8 common disease patterns listed in our CVPR2017 paper. Note that original radiology reports (associated with these chest x-ray studies) are not meant to be publicly shared for many reasons. The text-mined disease labels are expected to have accuracy >90%.Please find more details and benchmark performance of trained models based on 14 disease labels in our arxiv paper: 1705.02315

Dataset Structure

Data Instances

A sample from the training set is provided below:

{'image_file_path': '/root/.cache/huggingface/datasets/downloads/extracted/95db46f21d556880cf0ecb11d45d5ba0b58fcb113c9a0fff2234eba8f74fe22a/images/00000798_022.png',
 'image': <PIL.PngImagePlugin.PngImageFile image mode=L size=1024x1024 at 0x7F2151B144D0>,
 'labels': [9, 3]}

Data Fields

The data instances have the following fields:

  • image_file_path a str with the image path
  • image: A PIL.Image.Image object containing the image. Note that when accessing the image column: dataset[0]["image"] the image file is automatically decoded. Decoding of a large number of image files might take a significant amount of time. Thus it is important to first query the sample index before the "image" column, i.e. dataset[0]["image"] should always be preferred over dataset["image"][0].
  • labels: an int classification label.
Class Label Mappings ```json { "No Finding": 0, "Atelectasis": 1, "Cardiomegaly": 2, "Effusion": 3, "Infiltration": 4, "Mass": 5, "Nodule": 6, "Pneumonia": 7, "Pneumothorax": 8, "Consolidation": 9, "Edema": 10, "Emphysema": 11, "Fibrosis": 12, "Pleural_Thickening": 13, "Hernia": 14 } ```

Label distribution on the dataset:

labelsobsfreq
No Finding603610.426468
Infiltration198940.140557
Effusion133170.0940885
Atelectasis115590.0816677
Nodule63310.0447304
Mass57820.0408515
Pneumothorax53020.0374602
Consolidation46670.0329737
Pleural_Thickening33850.023916
Cardiomegaly27760.0196132
Emphysema25160.0177763
Edema23030.0162714
Fibrosis16860.0119121
Pneumonia14310.0101104
Hernia2270.00160382

Data Splits

traintest
# of examples8652425596

Label distribution by dataset split:

labels('Train', 'obs')('Train', 'freq')('Test', 'obs')('Test', 'freq')
No Finding505000.48339298610.266032
Infiltration137820.13192361120.164891
Effusion86590.08288546580.125664
Atelectasis82800.079257232790.0884614
Nodule47080.045065616230.0437856
Mass40340.03861417480.0471578
Consolidation28520.027299718150.0489654
Pneumothorax26370.025241726650.0718968
Pleural_Thickening22420.021460711430.0308361
Cardiomegaly17070.016339610690.0288397
Emphysema14230.013621110930.0294871
Edema13780.01319049250.0249548
Fibrosis12510.01197474350.0117355
Pneumonia8760.008385185550.0149729
Hernia1410.00134967860.00232012

Dataset Creation

Curation Rationale

[More Information Needed]

Source Data

Initial Data Collection and Normalization

[More Information Needed]

Who are the source language producers?

[More Information Needed]

Annotations

Annotation process

[More Information Needed]

Who are the annotators?

[More Information Needed]

Personal and Sensitive Information

[More Information Needed]

Considerations for Using the Data

Social Impact of Dataset

[More Information Needed]

Discussion of Biases

[More Information Needed]

Other Known Limitations

[More Information Needed]

Additional Information

Dataset Curators

[More Information Needed]

License and attribution

There are no restrictions on the use of the NIH chest x-ray images. However, the dataset has the following attribution requirements:

  • Provide a link to the NIH download site: https://nihcc.app.box.com/v/ChestXray-NIHCC
  • Include a citation to the CVPR 2017 paper (see Citation information section)
  • Acknowledge that the NIH Clinical Center is the data provider

Citation Information

@inproceedings{Wang_2017,
	doi = {10.1109/cvpr.2017.369},
	url = {https://doi.org/10.1109%2Fcvpr.2017.369},
	year = 2017,
	month = {jul},
	publisher = {{IEEE}
},
	author = {Xiaosong Wang and Yifan Peng and Le Lu and Zhiyong Lu and Mohammadhadi Bagheri and Ronald M. Summers},
	title = {{ChestX}-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases},
	booktitle = {2017 {IEEE} Conference on Computer Vision and Pattern Recognition ({CVPR})}
}

Contributions

Thanks to @alcazar90 for adding this dataset.

alkzar90/NIH-Chest-X-ray-dataset

Dataset

Dataset Card for NIH Chest X-ray dataset

62

92 commits

1 linked in READMEs

updated Sep 11, 2024

See the code

README

Dataset Card for NIH Chest X-ray dataset

Table of Contents

Dataset Description

Dataset Summary

ChestX-ray dataset comprises 112,120 frontal-view X-ray images of 30,805 unique patients with the text-mined fourteen disease image labels (where each image can have multi-labels), mined from the associated radiological reports using natural language processing. Fourteen common thoracic pathologies include Atelectasis, Consolidation, Infiltration, Pneumothorax, Edema, Emphysema, Fibrosis, Effusion, Pneumonia, Pleural_thickening, Cardiomegaly, Nodule, Mass and Hernia, which is an extension of the 8 common disease patterns listed in our CVPR2017 paper. Note that original radiology reports (associated with these chest x-ray studies) are not meant to be publicly shared for many reasons. The text-mined disease labels are expected to have accuracy >90%.Please find more details and benchmark performance of trained models based on 14 disease labels in our arxiv paper: 1705.02315

Dataset Structure

Data Instances

A sample from the training set is provided below:

{'image_file_path': '/root/.cache/huggingface/datasets/downloads/extracted/95db46f21d556880cf0ecb11d45d5ba0b58fcb113c9a0fff2234eba8f74fe22a/images/00000798_022.png',
 'image': <PIL.PngImagePlugin.PngImageFile image mode=L size=1024x1024 at 0x7F2151B144D0>,
 'labels': [9, 3]}

Data Fields

The data instances have the following fields:

  • image_file_path a str with the image path
  • image: A PIL.Image.Image object containing the image. Note that when accessing the image column: dataset[0]["image"] the image file is automatically decoded. Decoding of a large number of image files might take a significant amount of time. Thus it is important to first query the sample index before the "image" column, i.e. dataset[0]["image"] should always be preferred over dataset["image"][0].
  • labels: an int classification label.
Class Label Mappings ```json { "No Finding": 0, "Atelectasis": 1, "Cardiomegaly": 2, "Effusion": 3, "Infiltration": 4, "Mass": 5, "Nodule": 6, "Pneumonia": 7, "Pneumothorax": 8, "Consolidation": 9, "Edema": 10, "Emphysema": 11, "Fibrosis": 12, "Pleural_Thickening": 13, "Hernia": 14 } ```

Label distribution on the dataset:

labelsobsfreq
No Finding603610.426468
Infiltration198940.140557
Effusion133170.0940885
Atelectasis115590.0816677
Nodule63310.0447304
Mass57820.0408515
Pneumothorax53020.0374602
Consolidation46670.0329737
Pleural_Thickening33850.023916
Cardiomegaly27760.0196132
Emphysema25160.0177763
Edema23030.0162714
Fibrosis16860.0119121
Pneumonia14310.0101104
Hernia2270.00160382

Data Splits

traintest
# of examples8652425596

Label distribution by dataset split:

labels('Train', 'obs')('Train', 'freq')('Test', 'obs')('Test', 'freq')
No Finding505000.48339298610.266032
Infiltration137820.13192361120.164891
Effusion86590.08288546580.125664
Atelectasis82800.079257232790.0884614
Nodule47080.045065616230.0437856
Mass40340.03861417480.0471578
Consolidation28520.027299718150.0489654
Pneumothorax26370.025241726650.0718968
Pleural_Thickening22420.021460711430.0308361
Cardiomegaly17070.016339610690.0288397
Emphysema14230.013621110930.0294871
Edema13780.01319049250.0249548
Fibrosis12510.01197474350.0117355
Pneumonia8760.008385185550.0149729
Hernia1410.00134967860.00232012

Dataset Creation

Curation Rationale

[More Information Needed]

Source Data

Initial Data Collection and Normalization

[More Information Needed]

Who are the source language producers?

[More Information Needed]

Annotations

Annotation process

[More Information Needed]

Who are the annotators?

[More Information Needed]

Personal and Sensitive Information

[More Information Needed]

Considerations for Using the Data

Social Impact of Dataset

[More Information Needed]

Discussion of Biases

[More Information Needed]

Other Known Limitations

[More Information Needed]

Additional Information

Dataset Curators

[More Information Needed]

License and attribution

There are no restrictions on the use of the NIH chest x-ray images. However, the dataset has the following attribution requirements:

  • Provide a link to the NIH download site: https://nihcc.app.box.com/v/ChestXray-NIHCC
  • Include a citation to the CVPR 2017 paper (see Citation information section)
  • Acknowledge that the NIH Clinical Center is the data provider

Citation Information

@inproceedings{Wang_2017,
	doi = {10.1109/cvpr.2017.369},
	url = {https://doi.org/10.1109%2Fcvpr.2017.369},
	year = 2017,
	month = {jul},
	publisher = {{IEEE}
},
	author = {Xiaosong Wang and Yifan Peng and Le Lu and Zhiyong Lu and Mohammadhadi Bagheri and Ronald M. Summers},
	title = {{ChestX}-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases},
	booktitle = {2017 {IEEE} Conference on Computer Vision and Pattern Recognition ({CVPR})}
}

Contributions

Thanks to @alcazar90 for adding this dataset.