Large Language Model Text Generation

20 repos

Libraries, frameworks, and pre-trained models for generating text using transformer-based large language models. The cluster centers on inference optimization and deployment infrastructure for LLMs, with strong emphasis on the Hugging Face ecosystem (transformers, text-generation-inference, safetensors formats). The Swallow family of instruction-tuned models (7B and 70B variants) represents the core pre-trained model implementations, while the broader cluster includes tooling for serving, quantization, and compatible endpoints for generative text tasks.

endpoints_compatible ·249
transformers ·249
text-generation-inference ·249
text-generation ·249
safetensors ·218
llama ·177
pytorch ·50
mistral ·43
mixtral ·29
conversational ·19