ray-project/llm-applications

A comprehensive guide to building RAG-based LLM applications for production.

OpenCSGs/llm-inference

llm-inference is a platform for publishing and managing llm inference, providing a wide range of…

neuralmagic/nm-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

rustformers/llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

allwefantasy/byzer-llm

Easy, fast, and cheap pretrain,finetune, serving for everyone

wisheverybodyhapi/llm

llm projects