7 repos
lm-sys/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for…
39,526
883 commits
hatakeyama-llm-team/FastChat
FastChatの編集版
1
878 commits
Peter-Devine/multilingual_mt_bench
A fork of the lm-sys/FastChat repo that evaluates models on multilingual versions of MT-Bench
3
828 commits
Stability-AI/FastChat
52
547 commits
S-LoRA/S-LoRA
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
1,923
23 commits
WukLab/preble
Stateful LLM Serving
106
546 commits
ztxz16/fastllm
fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署Deep…
5,015
4,741 commits
