Shadowgraph
TrendingAbout
Sign in
← Explore by area

Cluster 639616

5 repos

C++ · 2
Python · 2
JavaScript · 1
llm ·33,528
chat ·33,523
ai ·33,523
lora ·5,585
inference-engine ·5,585
intel ·5,580
api-rest ·5,580
tpu ·5,580
inferentia ·5,580
machine-learning ·5,580

Related clusters

LLM Quantization and ROCm Optimization38Qwen LLM Inference Optimization9Cluster 63361831Cluster 63928813GGUF quantized language models36LLM Inference Optimization & Serving18

aphrodite-engine/aphrodite-engine

Large-scale LLM inference engine

C++

1,860

2,667 commits

PygmalionAI/aphrodite-engine

Large-scale LLM inference engine

Python

1,860

2,701 commits

dphnAI/sonar

Large-scale LLM inference engine

Python

1,860

2,673 commits

tensorninja/ninfer-4090

Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, 149 tok/s code decode with…

C++

5

921 commits

SillyTavern/SillyTavern

LLM Frontend for Power Users.

JavaScript

33,523

10,895 commits