LLM Fine-tuning and Parameter-Efficient Adaptation

23 repos

Libraries and techniques for efficiently fine-tuning large language models using methods like LoRA and other parameter-efficient approaches. The cluster centers on frameworks like LlamaFactory and related tools that enable supervised fine-tuning, instruction tuning, and model adaptation without requiring full model retraining. Projects here demonstrate practical applications including domain-specific model variants (Bangla, Qwen-based), instruction-following improvements, and mixture-of-experts configurations.

Python · 14
HTML · 1
lora ·209,489
peft ·209,489
llm ·209,270
moe ·180,520
llama ·180,508
fine-tuning ·177,773
transformers ·176,628
qlora ·154,743
qwen ·150,625
deepseek ·150,625