Llama 2 Model Variants & Quantization

38 repos

Quantized and fine-tuned variants of Meta's Llama 2 language model, optimized for efficient local deployment using GGML and similar formats. The cluster centers on community adaptations of Llama 2 (particularly 7B and 13B parameter versions) that combine multiple training approaches—such as Hermes, Orca, Platypus, and Wizard—to improve instruction-following and reasoning capabilities while maintaining portability across consumer hardware.

Python · 1
facebook ·3,503
meta ·3,503
pytorch ·3,502
text-generation ·3,502
transformers ·3,502
llama ·3,497
llama-2 ·3,470
en ·2,881
text-generation-inference ·1,138
safetensors ·1,061