LoRA and PEFT for Language Models

8 repos

Parameter-efficient fine-tuning (PEFT) techniques, particularly Low-Rank Adaptation (LoRA), for adapting and customizing large language models with minimal computational overhead. The cluster includes implementations, adapters, and tools for efficiently training and deploying model variants across different domains and architectures, with support for formats like safetensors for model serialization.

Python · 1
lora ·75
peft ·75
safetensors ·72
en ·69
text-generation ·69
granite ·67
granite-library ·67
factuality ·35
guardian ·35
hallucination ·35