gmgu/LLMOps

stars

commits

Python

primary language

Mar 23, 2024

updated

README

This repository provides an hour-long seminar about distributed training large language models

sudo apt install libopenmpi-dev  # for mpi4py
pip install -r requirements.txt

python3 1_make_model.py
python3 2_make_dataset.py
. run.sh

python3 4_inference.py

8 commits

darshan8850/LLM_borrower

kimbyeolhee/Training-LLaMA

rioyokotalab/Megatron-Llama2

2023 ABCI Llama-2 継続学習プロジェクト

InasayaFlanderin/Multilingual-NLP

rediculous problem got assigned to that impossible to complete

zwx8981/LIQ3A

bigcode-project/Megatron-LM

Ongoing research training transformer models at scale

396

rhulha/lora

Train Large Language Models (LLM) using LoRA

Modalities/modalities

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

111

Python

98.7%

Shell

1.3%

README

This repository provides an hour-long seminar about distributed training large language models

sudo apt install libopenmpi-dev  # for mpi4py
pip install -r requirements.txt

python3 1_make_model.py
python3 2_make_dataset.py
. run.sh

python3 4_inference.py