OG_prot90: An Open Genomic Protein Dataset

The OG_prot90 dataset is a protein-only dataset, created by clustering the Open Genomic dataset (OG) at 90% sequence identity.

MMseqs2 linclust (Steinegger and Söding 2018) was used to cluster all 400M protein sequences from the OG dataset, resulting in 85M protein sequences. Sequences were clustered at 90% sequence id and 90% sequence coverage.

Use

import datasets
ds = datasets.load_dataset('tattabio/OG_prot90')

To preview the dataset without downloading, load in streaming mode:

import datasets
ds = datasets.load_dataset('tattabio/OG_prot90', streaming=True)['train']
print(next(iter(ds)))

Citation

BibTeX:

@article{Cornman2024,
  title = {The OMG dataset: An Open MetaGenomic corpus for mixed-modality genomic language modeling},
  url = {https://www.biorxiv.org/content/early/2024/08/17/2024.08.14.607850},
  DOI = {10.1101/2024.08.14.607850},
  publisher = {Cold Spring Harbor Laboratory},
  author = {Cornman, Andre and West-Roberts, Jacob and Camargo, Antonio Pedro and Roux, Simon and Beracochea, Martin and Mirdita, Milot and Ovchinnikov, Sergey and Hwang, Yunha},
  year = {2024},
}