3 repos
noonghunna/club-3090
Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp,…
2,259
1,810 commits
Jackson57279/llm-optimizer-compose
No description
0
4 commits
rce/vllm-5090
Running and benchmarking LLMs on Nvidia RTX 5090 using vLLM
18 commits