Shadowgraph
TrendingAbout
Sign in

EhimeNLP/AcademicRoBERTa

Model

Model description

3

6 commits

1 linked in READMEs

updated Aug 6, 2024

See the code

README

Model description

We pretrained a RoBERTa-based Japanese masked language model on paper abstracts from the academic database CiNii Articles.
A Japanese Masked Language Model for Academic Domain

Vocabulary

The vocabulary consists of 32000 tokens including subwords induced by the unigram language model of sentencepiece.

license: apache-2.0
language:ja

endpoints_compatible
fill-mask
roberta
safetensors
transformers

Contributors

EhimeNLP

6 commits

Similar repos

nlp-waseda/roberta-base-japanese

Model

nlp-waseda/roberta-base-japanese

32

nlp-waseda/roberta-large-japanese

Model

nlp-waseda/roberta-large-japanese

23

tohoku-nlp/bert-base-japanese-v3

Model

BERT base Japanese (unidic-lite with whole word masking, CC-100 and jawiki-20230102)

65

nlp-waseda/roberta-large-japanese-seq512

Model

nlp-waseda/roberta-large-japanese-seq512

3

tohoku-nlp/bert-base-japanese-char-v3

Model

BERT base Japanese (character-level tokenization with whole word masking, CC-100 and…

11

tohoku-nlp/bert-large-japanese-v2

Model

BERT large Japanese (unidic-lite with whole word masking, CC-100 and jawiki-20230102)

14

tohoku-nlp/bert-base-japanese-v2

Model

BERT base Japanese (unidic-lite with whole word masking, jawiki-20200831)

26

cl-tohoku/bert-base-japanese-v2

Model

BERT base Japanese (unidic-lite with whole word masking, jawiki-20200831)

26

Linked in READMEs

yuzhimanhua/Awesome-Scientific-Language-Models

A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific…

665

README badge

EhimeNLP/AcademicRoBERTa

Model

Model description

3

6 commits

1 linked in READMEs

updated Aug 6, 2024

See the code

README

Model description

We pretrained a RoBERTa-based Japanese masked language model on paper abstracts from the academic database CiNii Articles.
A Japanese Masked Language Model for Academic Domain

Vocabulary

The vocabulary consists of 32000 tokens including subwords induced by the unigram language model of sentencepiece.

license: apache-2.0
language:ja

endpoints_compatible
fill-mask
roberta
safetensors
transformers

Similar repos

nlp-waseda/roberta-base-japanese

Model

nlp-waseda/roberta-base-japanese

32

nlp-waseda/roberta-large-japanese

Model

nlp-waseda/roberta-large-japanese

23

tohoku-nlp/bert-base-japanese-v3

Model

BERT base Japanese (unidic-lite with whole word masking, CC-100 and jawiki-20230102)

65

nlp-waseda/roberta-large-japanese-seq512

Model

nlp-waseda/roberta-large-japanese-seq512

3

tohoku-nlp/bert-base-japanese-char-v3

Model

BERT base Japanese (character-level tokenization with whole word masking, CC-100 and…

11

tohoku-nlp/bert-large-japanese-v2

Model

BERT large Japanese (unidic-lite with whole word masking, CC-100 and jawiki-20230102)

14

tohoku-nlp/bert-base-japanese-v2

Model

BERT base Japanese (unidic-lite with whole word masking, jawiki-20200831)

26

cl-tohoku/bert-base-japanese-v2

Model

BERT base Japanese (unidic-lite with whole word masking, jawiki-20200831)

26

Linked in READMEs

yuzhimanhua/Awesome-Scientific-Language-Models

A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific…

665

README badge

Contributors

EhimeNLP

6 commits