nainiayoub/moroccan-darija-datasets

A list of Moroccan Darija Datasets grouped by name, data source, region and size.

61

17 commits

updated May 10, 2024

See the code

README

Moroccan Darija Datasets :morocco:

This repository aims to group Moroccan Darija Datasets to help make them available at once without the need to spend endless amounts of time looking for one. The datasets are grouped by name, data source, region, and size to provide as much information as possible to select the best dataset for the task at hand.

Datasets (13)

DatasetData sourceRegionSizeLinkReference
1Moroccan Arabic Sentiment Analysis CorpusTwitterMaghrebi (Moroccan)2000 entriessource2018 [1]
2IADD: An integrated Arabic dialect identification dataset Varied Maghrebi, Levantine, Egyptian and Gulf135,804 textssource2022 [2]
3Dialectal Arabic DatasetsTwitterMaghrebi, Levantine, Egyptian and Gulf350 tweets per regionsource2018 [3]
4MSDA Open DatasetsSocial media postsArabic-source2020 [4]
5Moroccan Dialect Darija Open DatasetOpen source contributionsMaghrebi (Moroccan)More than 13K source2021 [5]
6Goud.ma: a News Dataset for Summarization in Moroccan Darijagoud.maMaghrebi (Moroccan)158k news articlessource2022 [6]
7MNAD : Moroccan News Articles DatasetMoroccan news websitesMaghrebi (Moroccan)418 563 documentssource2021 [7]
8QADI: QCRI Arabic Dialect IdentificationTwitterMaghrebi, Levantine, Egyptian and Gulf540k tweetssource2020 [8]
9Dvoice : An open source dataset for Automatic Speech Recognition on Moroccan dialectal ArabicVoice recordings + text transcriptionsMaghrebi (Moroccan)2392 training and 600 testing filessource2021 [9]
10ASAYAR: A Dataset for Arabic-Latin Scene Text Localization in Highway Traffic PanelsImages collected on different Moroccan highways, annotated manually.Maghrebi (Moroccan)1763 imagessource2020 [10]
11OMCD: Offensive Moroccan Comments DatasetA collection of comments from YouTube that have been labeled for offensive content.Maghrebi (Moroccan)8024 comments written in Moroccan dialectsource2023 [11]
12MORED: A Moroccan Buildings’ Electricity Consumption DatasetA dataset that comprises electricity consumption data of various Moroccan premisesMaghrebi (Moroccan)-source2020 [12]
13DarNERcorp: a Named Entity Recognition Corpus in the Moroccan DialectarNERcorp is a manually annotated corpus for Named Entity Recognition (NER) in the Moroccan Dialect or DarijaMaghrebi (Moroccan)65,905 tokenssource2023 [13]

References

arabic-dataset
arabic-language
arabic-nlp
darija-dataset
darija-dialect
darija-nlp
moroccan-dataset

nainiayoub/moroccan-darija-datasets

A list of Moroccan Darija Datasets grouped by name, data source, region and size.

61

17 commits

updated May 10, 2024

See the code

README

Moroccan Darija Datasets :morocco:

This repository aims to group Moroccan Darija Datasets to help make them available at once without the need to spend endless amounts of time looking for one. The datasets are grouped by name, data source, region, and size to provide as much information as possible to select the best dataset for the task at hand.

Datasets (13)

DatasetData sourceRegionSizeLinkReference
1Moroccan Arabic Sentiment Analysis CorpusTwitterMaghrebi (Moroccan)2000 entriessource2018 [1]
2IADD: An integrated Arabic dialect identification dataset Varied Maghrebi, Levantine, Egyptian and Gulf135,804 textssource2022 [2]
3Dialectal Arabic DatasetsTwitterMaghrebi, Levantine, Egyptian and Gulf350 tweets per regionsource2018 [3]
4MSDA Open DatasetsSocial media postsArabic-source2020 [4]
5Moroccan Dialect Darija Open DatasetOpen source contributionsMaghrebi (Moroccan)More than 13K source2021 [5]
6Goud.ma: a News Dataset for Summarization in Moroccan Darijagoud.maMaghrebi (Moroccan)158k news articlessource2022 [6]
7MNAD : Moroccan News Articles DatasetMoroccan news websitesMaghrebi (Moroccan)418 563 documentssource2021 [7]
8QADI: QCRI Arabic Dialect IdentificationTwitterMaghrebi, Levantine, Egyptian and Gulf540k tweetssource2020 [8]
9Dvoice : An open source dataset for Automatic Speech Recognition on Moroccan dialectal ArabicVoice recordings + text transcriptionsMaghrebi (Moroccan)2392 training and 600 testing filessource2021 [9]
10ASAYAR: A Dataset for Arabic-Latin Scene Text Localization in Highway Traffic PanelsImages collected on different Moroccan highways, annotated manually.Maghrebi (Moroccan)1763 imagessource2020 [10]
11OMCD: Offensive Moroccan Comments DatasetA collection of comments from YouTube that have been labeled for offensive content.Maghrebi (Moroccan)8024 comments written in Moroccan dialectsource2023 [11]
12MORED: A Moroccan Buildings’ Electricity Consumption DatasetA dataset that comprises electricity consumption data of various Moroccan premisesMaghrebi (Moroccan)-source2020 [12]
13DarNERcorp: a Named Entity Recognition Corpus in the Moroccan DialectarNERcorp is a manually annotated corpus for Named Entity Recognition (NER) in the Moroccan Dialect or DarijaMaghrebi (Moroccan)65,905 tokenssource2023 [13]

References

arabic-dataset
arabic-language
arabic-nlp
darija-dataset
darija-dialect
darija-nlp
moroccan-dataset