0
2 commits
1 linked in READMEs
updated May 4, 2024
1 commits
mit-han-lab/Llama-2-7B-QServe-g128
1
mit-han-lab/Llama-2-13B-QServe
mit-han-lab/Llama-2-13B-QServe-g128
mit-han-lab/vicuna-7b-v1.5-QServe
mit-han-lab/vicuna-7b-v1.5-QServe-g128
squeeze-ai-lab/sq-llama-2-7b-w3-s0
squeeze-ai-lab/sq-llama-2-7b-w4-s0
emozilla/Yarn-Llama-2-7b-8k
mit-han-lab/omniserve
[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25]…
860
