Shadowgraph
TrendingBuzzTop stargazers
Chrome extension
Sign in

songlab/gpn-brassicales

Model

GPN trained on *Arabidopsis thaliana* and 7 other Brassicales

3

14 commits

8 repos using this model

3 linked in READMEs

updated Jan 28, 2025

See the code

README

GPN trained on Arabidopsis thaliana and 7 other Brassicales

See https://github.com/songlab-cal/gpn for more details.

Basic usage:

import gpn.model
from transformers import AutoModel, AutoModelForMaskedLM

model = AutoModel.from_pretrained("songlab/gpn-brassicales")
# or
model = AutoModelForMaskedLM.from_pretrained("songlab/gpn-brassicales")

Some hparams:

  • repeat_weight: 0.1
  • lr: 120k at 1e-3 + 30k cosine decay
biology
ConvNet
endpoints_compatible
fill-mask
genomics
language-model
pytorch
safetensors
transformers
variant-effect-prediction

Similar repos

songlab/gpn-msa-sapiens

Model

GPN-MSA trained on humans and 89 other vertebrates

8

JGI-Eukaryotes/gpn_grass

forking gpn repo for a project. building the model with 8 grass species

0

songlab-cal/gpn

Genomic Pretrained Network - GPN, GPN-MSA, PhyloGPN, GPN-Star

385

PoetschLab/GROVER

Model

This is the official pre-trained model introduced in DNA language model GROVER learns sequence…

17

AIRI-Institute/gena-lm-bert-base-t2t

Model

GENA-LM (gena-lm-bert-base-t2t)

4

AIRI-Institute/gena-lm-bert-large-t2t

Model

GENA-LM (gena-lm-bert-large-t2t)

10

AIRI-Institute/gena-lm-bigbird-base-t2t

Model

GENA-LM (gena-lm-bigbird-base-t2t)

12

yangheng/PlantRNA-FM

Model

PlantRNA-FM: An Interpretable RNA Foundation Model for Exploration Functional RNA Motifs in Plants

9

Used in code

JGI-Eukaryotes/gpn_grass

forking gpn repo for a project. building the model with 8 grass species

0

3 files

frederikkemarin/BEND

Benchmarking DNA Language Models on Biologically Meaningful Tasks

134

1 file

SII-AGI4S/ViroBench

16

1 file

JiaqiLi1024/DeepGeSeq

11

1 file

DhruvaRajwade/Seq2Contact

Code for our work on Protein-DNA binding prediction using FMs+CrossAttention

10

1 file

TerminatorJ/BERTLocRNA

Using Large language model to predict localization

1

1 file

nistring/DNA-embedding

0

1 file

SohanMupparapu/bend

0

1 file

Linked in READMEs

songlab-cal/gpn

Genomic Pretrained Network - GPN, GPN-MSA, PhyloGPN, GPN-Star

385

README badge

frederikkemarin/BEND

Benchmarking DNA Language Models on Biologically Meaningful Tasks

134

README badge

SohanMupparapu/bend

0

README badge

songlab/gpn-brassicales

Model

GPN trained on *Arabidopsis thaliana* and 7 other Brassicales

3

14 commits

8 repos using this model

3 linked in READMEs

updated Jan 28, 2025

See the code

README

GPN trained on Arabidopsis thaliana and 7 other Brassicales

See https://github.com/songlab-cal/gpn for more details.

Basic usage:

import gpn.model
from transformers import AutoModel, AutoModelForMaskedLM

model = AutoModel.from_pretrained("songlab/gpn-brassicales")
# or
model = AutoModelForMaskedLM.from_pretrained("songlab/gpn-brassicales")

Some hparams:

  • repeat_weight: 0.1
  • lr: 120k at 1e-3 + 30k cosine decay
biology
ConvNet
endpoints_compatible
fill-mask
genomics
language-model
pytorch
safetensors
transformers
variant-effect-prediction

Similar repos

songlab/gpn-msa-sapiens

Model

GPN-MSA trained on humans and 89 other vertebrates

8

JGI-Eukaryotes/gpn_grass

forking gpn repo for a project. building the model with 8 grass species

0

songlab-cal/gpn

Genomic Pretrained Network - GPN, GPN-MSA, PhyloGPN, GPN-Star

385

PoetschLab/GROVER

Model

This is the official pre-trained model introduced in DNA language model GROVER learns sequence…

17

AIRI-Institute/gena-lm-bert-base-t2t

Model

GENA-LM (gena-lm-bert-base-t2t)

4

AIRI-Institute/gena-lm-bert-large-t2t

Model

GENA-LM (gena-lm-bert-large-t2t)

10

AIRI-Institute/gena-lm-bigbird-base-t2t

Model

GENA-LM (gena-lm-bigbird-base-t2t)

12

yangheng/PlantRNA-FM

Model

PlantRNA-FM: An Interpretable RNA Foundation Model for Exploration Functional RNA Motifs in Plants

9

Used in code

JGI-Eukaryotes/gpn_grass

forking gpn repo for a project. building the model with 8 grass species

0

3 files

frederikkemarin/BEND

Benchmarking DNA Language Models on Biologically Meaningful Tasks

134

1 file

SII-AGI4S/ViroBench

16

1 file

JiaqiLi1024/DeepGeSeq

11

1 file

DhruvaRajwade/Seq2Contact

Code for our work on Protein-DNA binding prediction using FMs+CrossAttention

10

1 file

TerminatorJ/BERTLocRNA

Using Large language model to predict localization

1

1 file

nistring/DNA-embedding

0

1 file

SohanMupparapu/bend

0

1 file

Linked in READMEs

songlab-cal/gpn

Genomic Pretrained Network - GPN, GPN-MSA, PhyloGPN, GPN-Star

385

README badge

frederikkemarin/BEND

Benchmarking DNA Language Models on Biologically Meaningful Tasks

134

README badge

SohanMupparapu/bend

0

README badge