Large Language Models and NLP Pretraining

8 repos

Frameworks and tools for training, fine-tuning, and deploying large pretrained language models, with particular emphasis on distributed training and multilingual support including Chinese NLP. The cluster centers on PyTorch-based ecosystems (PaddleNLP, PaddleFormers, FlagAI) that provide model architectures, pretraining pipelines, and inference infrastructure for production-scale NLP applications.

Python · 8
aigc ·4,124
chinese-nlp ·4,124
distributed-training ·4,124
multimodal ·4,124
pretrained-models ·4,124
pytorch ·4,124
transformers ·4,124