mit-han-lab/Llama-3-8B-QServe

Model

1

2 commits

1 linked in READMEs

updated May 4, 2024

README

conversational

endpoints_compatible

llama

pytorch

safetensors

text-generation

text-generation-inference

transformers

Contributors

1 commits

YS

1 commits

Similar repos

mit-han-lab/Llama-3-8B-QServe-g128

0

mit-han-lab/Llama-3-8B-Instruct-QServe

1

mit-han-lab/Llama-3-8B-Instruct-QServe-g128

2

meta-llama/Llama-Guard-3-8B

327

xinlai/Llama-3-70B-SFT

0

PowerServe/Llama-3.1-8B-PowerServe-QNN29-8G3

0

PowerServe/Llama-3.1-8B-PowerServe-QNN29-8G4

0

relaxml/Llama-2-7b-chat-E8PRVQ-3Bit

0

Linked in READMEs

mit-han-lab/omniserve

[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25]…

860

mit-han-lab/Llama-3-8B-QServe

Model

1

2 commits

1 linked in READMEs

updated May 4, 2024

README

conversational

endpoints_compatible

llama

pytorch

safetensors

text-generation

text-generation-inference

transformers

Similar repos

mit-han-lab/Llama-3-8B-QServe-g128

0

mit-han-lab/Llama-3-8B-Instruct-QServe

1

mit-han-lab/Llama-3-8B-Instruct-QServe-g128

2

meta-llama/Llama-Guard-3-8B

327

xinlai/Llama-3-70B-SFT

0

PowerServe/Llama-3.1-8B-PowerServe-QNN29-8G3

0

PowerServe/Llama-3.1-8B-PowerServe-QNN29-8G4

0

relaxml/Llama-2-7b-chat-E8PRVQ-3Bit

0

Linked in READMEs

mit-han-lab/omniserve

[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25]…

860

Contributors

1 commits

YS

1 commits