Llama Model Variants and Inference

13 repos

Optimized versions and serving implementations of Meta's Llama language models, particularly the 3.x series. This cluster covers different quantization strategies, context window extensions, and inference frameworks (including text-generation-inference endpoints) that make these models practical for various deployment scenarios. Most repos are model variants rather than novel architectures—they represent engineering work around making Llama models faster, smaller, or more capable for specific use cases.

Related clusters