HiTZ/Multilingual-Medical-Corpus

Dataset

45

stars

6

commits

1

linked in READMEs

Apr 12, 2024

updated

medical

README


Mutilingual Medical Corpus

Multilingual-Medical-Corpus a 3 billion word multilingual corpus for training LLMs adapted to the medical domain. Multilingual-Medical-Corpus includes four languages, namely, English, Spanish, French, and Italian.

Corpus Description

  • Developed by: Iker García-Ferrero, Rodrigo Agerri, Aitziber Atutxa Salazar, Elena Cabrio, Iker de la Iglesia, Alberto Lavelli, Bernardo Magnini, Benjamin Molinet, Johana Ramirez-Romero, German Rigau, Jose Maria Villa-Gonzalez, Serena Villata and Andrea Zaninello
  • Contact: Iker García-Ferrero and Rodrigo Agerri
  • Website: https://univ-cotedazur.eu/antidote
  • Funding: CHIST-ERA XAI 2019 call. Antidote (PCI2020-120717-2) funded by MCIN/AEI /10.13039/501100011033 and by European Union NextGenerationEU/PRTR
  • Language(s) (NLP): English, Spanish, French, Italian
  • License: apache-2.0
Data sources and word counts by language.
LanguageSourceWords
EnglishClinicalTrials127.4M
EMEA12M
PubMed968.4M
SpanishEMEA13.6M
PubMed8.4M
Medical Crawler918M
SPACC350K
UFAL10.5M
WikiMed5.2M
FrenchPubMed1.4M
Science Direct15.2M
Wikipedia - Médecine5M
EDP48K
Google Patents654M
ItalianMedical Commoncrawl - IT67M
Drug instructions30.5M
Wikipedia - Medicina13.3M
E3C Corpus - IT11.6M
Medicine descriptions6.3M
Medical theses5.8M
Medical websites4M
PubMed2.3M
Supplement description1.3M
Medical notes975K
Pathologies157K
Medical test simulations26K
Clinical cases20K

Open Source Models trained with Multilingual-Medical-Corpus:

HiTZ/Medical-mT5-largeHiTZ/Medical-mT5-xlHiTZ/Medical-mT5-large-multitaskHiTZ/Medical-mT5-xl-multitask
Param. no.738M3B738M3B
TaskLanguage ModelingLanguage ModelingMultitask Sequence LabelingMultitask Sequence Labeling

Citation

@misc{garcíaferrero2024medical,
      title={Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain}, 
      author={Iker García-Ferrero and Rodrigo Agerri and Aitziber Atutxa Salazar and Elena Cabrio and Iker de la Iglesia and Alberto Lavelli and Bernardo Magnini and Benjamin Molinet and Johana Ramirez-Romero and German Rigau and Jose Maria Villa-Gonzalez and Serena Villata and Andrea Zaninello},
      year={2024},
      eprint={2404.07613},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

Contributors

Iker

6 commits

HiTZ/Multilingual-Medical-Corpus

Dataset

45

stars

6

commits

1

linked in READMEs

Apr 12, 2024

updated

medical

README


Mutilingual Medical Corpus

Multilingual-Medical-Corpus a 3 billion word multilingual corpus for training LLMs adapted to the medical domain. Multilingual-Medical-Corpus includes four languages, namely, English, Spanish, French, and Italian.

Corpus Description

  • Developed by: Iker García-Ferrero, Rodrigo Agerri, Aitziber Atutxa Salazar, Elena Cabrio, Iker de la Iglesia, Alberto Lavelli, Bernardo Magnini, Benjamin Molinet, Johana Ramirez-Romero, German Rigau, Jose Maria Villa-Gonzalez, Serena Villata and Andrea Zaninello
  • Contact: Iker García-Ferrero and Rodrigo Agerri
  • Website: https://univ-cotedazur.eu/antidote
  • Funding: CHIST-ERA XAI 2019 call. Antidote (PCI2020-120717-2) funded by MCIN/AEI /10.13039/501100011033 and by European Union NextGenerationEU/PRTR
  • Language(s) (NLP): English, Spanish, French, Italian
  • License: apache-2.0
Data sources and word counts by language.
LanguageSourceWords
EnglishClinicalTrials127.4M
EMEA12M
PubMed968.4M
SpanishEMEA13.6M
PubMed8.4M
Medical Crawler918M
SPACC350K
UFAL10.5M
WikiMed5.2M
FrenchPubMed1.4M
Science Direct15.2M
Wikipedia - Médecine5M
EDP48K
Google Patents654M
ItalianMedical Commoncrawl - IT67M
Drug instructions30.5M
Wikipedia - Medicina13.3M
E3C Corpus - IT11.6M
Medicine descriptions6.3M
Medical theses5.8M
Medical websites4M
PubMed2.3M
Supplement description1.3M
Medical notes975K
Pathologies157K
Medical test simulations26K
Clinical cases20K

Open Source Models trained with Multilingual-Medical-Corpus:

HiTZ/Medical-mT5-largeHiTZ/Medical-mT5-xlHiTZ/Medical-mT5-large-multitaskHiTZ/Medical-mT5-xl-multitask
Param. no.738M3B738M3B
TaskLanguage ModelingLanguage ModelingMultitask Sequence LabelingMultitask Sequence Labeling

Citation

@misc{garcíaferrero2024medical,
      title={Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain}, 
      author={Iker García-Ferrero and Rodrigo Agerri and Aitziber Atutxa Salazar and Elena Cabrio and Iker de la Iglesia and Alberto Lavelli and Bernardo Magnini and Benjamin Molinet and Johana Ramirez-Romero and German Rigau and Jose Maria Villa-Gonzalez and Serena Villata and Andrea Zaninello},
      year={2024},
      eprint={2404.07613},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

Contributors

Iker

6 commits