RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.
39
14 commits
1 linked in READMEs
updated Sep 15, 2022
RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.
Read more about the model in this blog post (in Russian).
See its implementation, as well as the pretraining and finetuning code, at https://github.com/yandex-research/RuLeanALBERT.
RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.
39
14 commits
1 linked in READMEs
updated Sep 15, 2022
RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.
Read more about the model in this blog post (in Russian).
See its implementation, as well as the pretraining and finetuning code, at https://github.com/yandex-research/RuLeanALBERT.
