4 repos
MLSysU/EcoServe
[OSDI' 26] Efficient LLM Serving on Commodity GPU Clusters with Data-Reduced Cross-Instance…
24
3 commits
Multi-LLM/prism-research
Research prototype of PRISM — a cost-efficient multi-LLM serving system with flexible time- and…
77
4 commits
infinigence/Semi-PD
A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained…
131
16 commits
Hanchenli/vllm-continuum
Preview Code for Continuum Paper
102
9 commits
