Updates

• 2024/07/09: we also uploaded a new version of YODAS as YODAS2, it provides unsegmented audios and higher sampling rate (24k)

README

This is the YODAS manual/automatic subset from our YODAS dataset, it has 369,510 hours of speech.

This dataset contains audio utterances and corresponding captions (manual or automatic) from YouTube. Note that manual caption only indicates that it is uploaded by users, but not necessarily transcribed by a human

For more details about YODAS dataset, please refer to our paper

Usage:

Considering the extremely large size of the entire dataset, we support two modes of dataset loadings:

standard mode: each subset will be downloaded to the local dish before first iterating.

from datasets import load_dataset

# Note this will take very long time to download and preprocess
# you can try small subset for testing purpose
ds = load_dataset('espnet/yodas', 'en000')
print(next(iter(ds['train'])))

streaming mode most of the files will be streamed instead of downloaded to your local deivce. It can be used to inspect this dataset quickly.

from datasets import load_dataset

# this streaming loading will finish quickly
ds = load_dataset('espnet/yodas', 'en000', streaming=True)


#{'id': '9774', 'utt_id': 'YoRjzEnRcqu-00000-00000716-00000819', 'audio': {'path': None, 'array': array([-0.009552  , -0.01086426, -0.012146  , ..., -0.01992798,
#       -0.01885986, -0.01074219]), 'sampling_rate': 16000}, 'text': 'There is a saying'}
print(next(iter(ds['train'])))

Subsets/Shards

There are 149 languages in this dataset, each language is sharded into at least 1 shard to make it easy for our processing and uploading purposes. The raw data of each shard contains 500G at most.

Statistics of each shard can be found in the last section.

We distinguish manual caption subset and automatic caption subset by the first digit in each shard's name. The first digit is 0 if it contains manual captions, 1 if it contains automatic captions.

For example, en000 to en005 are the English shards containing manual subsets, and en100 to en127 contains the automatic subsets.

Reference

@inproceedings{li2023yodas,
  title={Yodas: Youtube-Oriented Dataset for Audio and Speech},
  author={Li, Xinjian and Takamichi, Shinnosuke and Saeki, Takaaki and Chen, William and Shiota, Sayaka and Watanabe, Shinji},
  booktitle={2023 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)},
  pages={1--8},
  year={2023},
  organization={IEEE}
}

Contact

If you have any questions, feel free to contact us at the following email address.

We made sure that our dataset only consisted of videos with CC licenses during our downloading. But in case you find your video unintentionally included in our dataset and would like to delete it, you can send a delete request to the following email.

Remove the parenthesis () from the following email address

(lixinjian)(1217)@gmail.com

Statistics

Note that there are no overlappings across different subsets, each audio can be included in the dataset at most once.