7 repos
Isekai-Creation/lmdeploy
No description
0
1,786 commits
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
8,079
2,101 commits
Trangle/lmdeploy-dev
lmdeploy-dev
763 commits
sands-lab/FOCUS
[ICML 2026] Official implementation of "FOCUS: DLLMs Know How to Tame Their Compute Bound".
19
1,727 commits
zh-nj/lmdeploy-v100
This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream…
21
6 commits
PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
3,716
5,333 commits
ztxz16/fastllm
fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署Deep…
5,059
4,741 commits
