qanastek/MORFITT

Dataset

MORFITT

0

21 commits

2 linked in READMEs

updated Aug 25, 2023

See the code

README

MORFITT

Data (Zenodo) | Publication (HAL)

Yanis LABRAK, Richard DUFOUR, Mickaël ROUVIER

or Python

We introduce MORFITT, the first multi-label corpus for the classification of specialties in the medical field, in French. MORFITT is composed of 3,624 summaries of scientific articles from PubMed, annotated in 12 specialties. The article details the corpus, the experiments and the preliminary results obtained using a classifier based on the pre-trained language model CamemBERT.

For more details, please refer to our paper:

MORFITT: A multi-label topic classification for French Biomedical literature (HAL)

Key Features

Documents distribution

TrainDevTest
1,5141,0221,088

Multi-label distribution

TrainDevTestTotal
Vétérinaire320250254824
Étiologie317202222741
Psychologie255175179609
Chirurgie223169157549
Génétique207139159505
Physiologie217125148490
Pharmacologie11284103299
Microbiologie1157286273
Immunologie1068670262
Chimie945365212
Virologie765767200
Parasitologie683450152
Total2,1101,4461,5605,116

Number of labels per document distribution

drawing

Co-occurences distribution

drawing

If you use HuggingFace Transformers

from datasets import load_dataset
dataset = load_dataset("qanastek/MORFITT")
print(dataset)

or

from datasets import load_dataset
dataset_base = load_dataset(
    'csv',
    data_files={
        'train': f"./train.tsv",
        'validation': f"./dev.tsv",
        'test': f"./test.tsv",
    },
    delimiter="\t",
)

License and Citation

The code is under Apache-2.0 License.

The MORFITT dataset is licensed under Attribution-ShareAlike 4.0 International (CC BY-SA 4.0). If you find this project useful in your research, please cite the following papers:

Labrak, Y., Rouvier, M., & Dufour, R. (2023). MORFITT : Un corpus multi-labels d’articles scientifiques français dans le domaine biomédical. In F. Boudin, B. Daille, R. Dufour, O. Khettari, M. Houbre, L. Jourdan, & N. Kooli (Eds.), 18e Conférence en Recherche d’Information et Applications – 16e Rencontres Jeunes Chercheurs en RI – 30e Conférence sur le Traitement Automatique des Langues Naturelles – 25e Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (pp. 66–70). ATALA. https://hal.science/hal-04131591

or using the bibtex:

@inproceedings{labrak:hal-04131591,
  TITLE = {{MORFITT : Un corpus multi-labels d'articles scientifiques fran{\c c}ais dans le domaine biom{\'e}dical}},
  AUTHOR = {Labrak, Yanis and Rouvier, Mickael and Dufour, Richard},
  URL = {https://hal.science/hal-04131591},
  BOOKTITLE = {{18e Conf{\'e}rence en Recherche d'Information et Applications -- 16e Rencontres Jeunes Chercheurs en RI -- 30e Conf{\'e}rence sur le Traitement Automatique des Langues Naturelles -- 25e Rencontre des {\'E}tudiants Chercheurs en Informatique pour le Traitement Automatique des Langues}},
  ADDRESS = {Paris, France},
  EDITOR = {Boudin, Florian and Daille, B{\'e}atrice and Dufour, Richard and Khettari, Oumaima and Houbre, Ma{\"e}l and Jourdan, L{\'e}ane and Kooli, Nihel},
  PUBLISHER = {{ATALA}},
  PAGES = {66-70},
  YEAR = {2023},
  KEYWORDS = {Analyse de documents scientifiques ; Jeux de donn{\'e}es compos{\'e}s des textes scientifiques},
  PDF = {https://hal.science/hal-04131591/file/1465546.pdf},
  HAL_ID = {hal-04131591},
  HAL_VERSION = {v1},
}
biology
medical

qanastek/MORFITT

Dataset

MORFITT

0

21 commits

2 linked in READMEs

updated Aug 25, 2023

See the code

README

MORFITT

Data (Zenodo) | Publication (HAL)

Yanis LABRAK, Richard DUFOUR, Mickaël ROUVIER

or Python

We introduce MORFITT, the first multi-label corpus for the classification of specialties in the medical field, in French. MORFITT is composed of 3,624 summaries of scientific articles from PubMed, annotated in 12 specialties. The article details the corpus, the experiments and the preliminary results obtained using a classifier based on the pre-trained language model CamemBERT.

For more details, please refer to our paper:

MORFITT: A multi-label topic classification for French Biomedical literature (HAL)

Key Features

Documents distribution

TrainDevTest
1,5141,0221,088

Multi-label distribution

TrainDevTestTotal
Vétérinaire320250254824
Étiologie317202222741
Psychologie255175179609
Chirurgie223169157549
Génétique207139159505
Physiologie217125148490
Pharmacologie11284103299
Microbiologie1157286273
Immunologie1068670262
Chimie945365212
Virologie765767200
Parasitologie683450152
Total2,1101,4461,5605,116

Number of labels per document distribution

drawing

Co-occurences distribution

drawing

If you use HuggingFace Transformers

from datasets import load_dataset
dataset = load_dataset("qanastek/MORFITT")
print(dataset)

or

from datasets import load_dataset
dataset_base = load_dataset(
    'csv',
    data_files={
        'train': f"./train.tsv",
        'validation': f"./dev.tsv",
        'test': f"./test.tsv",
    },
    delimiter="\t",
)

License and Citation

The code is under Apache-2.0 License.

The MORFITT dataset is licensed under Attribution-ShareAlike 4.0 International (CC BY-SA 4.0). If you find this project useful in your research, please cite the following papers:

Labrak, Y., Rouvier, M., & Dufour, R. (2023). MORFITT : Un corpus multi-labels d’articles scientifiques français dans le domaine biomédical. In F. Boudin, B. Daille, R. Dufour, O. Khettari, M. Houbre, L. Jourdan, & N. Kooli (Eds.), 18e Conférence en Recherche d’Information et Applications – 16e Rencontres Jeunes Chercheurs en RI – 30e Conférence sur le Traitement Automatique des Langues Naturelles – 25e Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (pp. 66–70). ATALA. https://hal.science/hal-04131591

or using the bibtex:

@inproceedings{labrak:hal-04131591,
  TITLE = {{MORFITT : Un corpus multi-labels d'articles scientifiques fran{\c c}ais dans le domaine biom{\'e}dical}},
  AUTHOR = {Labrak, Yanis and Rouvier, Mickael and Dufour, Richard},
  URL = {https://hal.science/hal-04131591},
  BOOKTITLE = {{18e Conf{\'e}rence en Recherche d'Information et Applications -- 16e Rencontres Jeunes Chercheurs en RI -- 30e Conf{\'e}rence sur le Traitement Automatique des Langues Naturelles -- 25e Rencontre des {\'E}tudiants Chercheurs en Informatique pour le Traitement Automatique des Langues}},
  ADDRESS = {Paris, France},
  EDITOR = {Boudin, Florian and Daille, B{\'e}atrice and Dufour, Richard and Khettari, Oumaima and Houbre, Ma{\"e}l and Jourdan, L{\'e}ane and Kooli, Nihel},
  PUBLISHER = {{ATALA}},
  PAGES = {66-70},
  YEAR = {2023},
  KEYWORDS = {Analyse de documents scientifiques ; Jeux de donn{\'e}es compos{\'e}s des textes scientifiques},
  PDF = {https://hal.science/hal-04131591/file/1465546.pdf},
  HAL_ID = {hal-04131591},
  HAL_VERSION = {v1},
}
biology
medical