Cluster 637425

34 repos

Python · 33

JavaScript · 1

pytorch ·143,837

llm-serving ·135,921

llm ·135,921

inference ·98,931

transformer ·98,931

model-serving ·98,931

gpt-oss ·92,059

kimi ·92,059

cuda ·92,059

amd ·92,059

Related clusters

Cluster 64557518 PyTorch Deep Learning & NLP23 LLM Inference Optimization & Serving10 Cluster 63361831 Cluster 6391466 Medical LLMs and Healthcare AI11

IBM/vllm

vLLM with support for span semantics

Python

11,161 commits

tenstorrent/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

13,019 commits

MotifTechnologies/vllm

vLLM with Motif-3 support, based on vLLM v0.20.2

Python

13,209 commits

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

92,059

16,100 commits

local-inference-lab/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

14,890 commits

lkm2835/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

15,696 commits

fort726/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

15,928 commits

CarrotShoo/vllm-old

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

7,439 commits

congcongchen123/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

6,833 commits

ttdxq/gfx906-vllm

vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60

Python

10,213 commits

1CatAI/1Cat-vLLM

V100 / SM70-focused vLLM engineering fork for modern LLM inference.

Python

1,073

14,695 commits

guqiong96/Lvllmds4-x

CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from…

Python

14,339 commits

charlie12345/vLLM_for_AMD

vLLM optimized for AMD

Python

15,902 commits

wtdcode/vllm-backport

Dogfooding vLLM backport for older GPUs.

Python

245

16,228 commits

yhfgyyf/vllm-deepseek-v4-sm89

Run DeepSeek-V4.1-Flash / DeepSeek-V4-Flash and GLM-5.3-Flash on SM89 (Ada / RTX 4090) and SM120…

Python

160

16,482 commits

guqiong96/Lvllmds4

A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for…

Python

15,896 commits

boson-ai/higgs-audio-vllm

Forked vLLM that supports higgs-audio model

Python

5,171 commits

XiaomiMiMo/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

4,350 commits

finnchen11/VLLM_PromptCache

Optimize vLLM with persistent system prompt caching and block reuse for faster, memory-efficient…

Python

6,565 commits

illinoisdata/lazy-attention

No description

Python

5,731 commits

krafton-ai/vllm-omni

No description

Python

1,519 commits

wodex1nhaoIeng/cmu-15642

No description

Python

1,284 commits

Celeste-jq/vllm-omni-hunyuanimage3

No description

Python

1,857 commits

baicai-1145/vllm-GPT-SoVITS

No description

Python

1,082 commits

vllm-project/vllm-omni

A framework for efficient model inference with omni-modality models

Python

6,872

2,863 commits

Green-Vial/openbmb-x-demo

openbmb x 昇腾挑战赛演示demo

Python

2,336 commits

vllm-project/recipes

Common recipes to run vLLM

JavaScript

1,023

670 commits

vllm-project/production-stack

vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance…

Python

2,600

697 commits

hadi-abdine/vllm_amd_sleep

No description

Python

1 commits

IBM/text-generation-inference

IBM development fork of https://github.com/huggingface/text-generation-inference

Python

281 commits

Taichu-AI/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python

1 commits

ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries…

Python

43,862

29,103 commits

mitkox/vllm-turboquant

vLLM TurboQuant

Python

619

3 commits

pytorch/benchmark

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

Python

1,044

2,273 commits