BERT Language Models & Variants

12 repos

Pre-trained BERT transformer models optimized for various languages and use cases, primarily implemented in PyTorch and JAX. This cluster contains multilingual BERT implementations including IndoBERT for Indonesian, BanglaBERT for Bengali, and KcBERT for Korean, alongside base English BERT models. The repositories focus on providing ready-to-use transformer checkpoints and their integration with modern deep learning frameworks, useful for transfer learning and fine-tuning on downstream NLP tasks.

Related clusters