LLM Fine-tuning and Model Optimization

2 repos

Tools and frameworks for fine-tuning large language models, particularly focused on Qwen2 and other open-source models using efficient training techniques. The cluster includes implementations for parameter-efficient fine-tuning, model compression, and training infrastructure built around safetensors format and tensorboard monitoring. Repositories range from toy models and reference implementations to production-oriented training pipelines.

Related clusters