learn-llm

This project is dedicated to learning and developing large language models (LLMs). It encompasses various stages of training and testing, including pretraining, supervised fine-tuning (SFT), and reinforcement learning (RL).

Repos

• pretrain: pretrain code
• sft: Supervised fine tunning
• rl: Reinforcement learning
• agents: some agents