mit-han-lab/vicuna-13b-v1.5-QServe-g128

Model

0

2 commits

1 linked in READMEs

updated May 4, 2024

README

endpoints_compatible

llama

pytorch

text-generation

text-generation-inference

transformers

Contributors

1 commits

YS

1 commits

Similar repos

mit-han-lab/vicuna-13b-v1.5-QServe

0

mit-han-lab/vicuna-7b-v1.5-QServe-g128

0

LLMs/Vicuna-13b-v1.1

0

mit-han-lab/vicuna-7b-v1.5-QServe

0

LLMs/Stable-Vicuna-13B

5

mit-han-lab/Llama-2-13B-QServe-g128

1

eachadea/vicuna-13b

**NOTE: Get the new version here: https://huggingface.co/eachadea/vicuna-13b-1.1**

93

squeeze-ai-lab/sq-vicuna-13b-v1.3-w4-s0

1

Linked in READMEs

mit-han-lab/omniserve

[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25]…

860

mit-han-lab/vicuna-13b-v1.5-QServe-g128

Model

0

2 commits

1 linked in READMEs

updated May 4, 2024

README

endpoints_compatible

llama

pytorch

text-generation

text-generation-inference

transformers

Similar repos

mit-han-lab/vicuna-13b-v1.5-QServe

0

mit-han-lab/vicuna-7b-v1.5-QServe-g128

0

LLMs/Vicuna-13b-v1.1

0

mit-han-lab/vicuna-7b-v1.5-QServe

0

LLMs/Stable-Vicuna-13B

5

mit-han-lab/Llama-2-13B-QServe-g128

1

eachadea/vicuna-13b

**NOTE: Get the new version here: https://huggingface.co/eachadea/vicuna-13b-1.1**

93

squeeze-ai-lab/sq-vicuna-13b-v1.3-w4-s0

1

Linked in READMEs

mit-han-lab/omniserve

[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25]…

860

Contributors

1 commits

YS

1 commits