relaxml/Llama-2-7b-chat-E8P-2Bit

Model

2

stars

5

commits

1

linked in READMEs

Feb 8, 2024

updated

conversational

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Browse cluster: Llama 2 Quantized Model Variants →

Contributors

5 commits

Similar repos

relaxml/Llama-2-70b-chat-E8P-2Bit

6

relaxml/Llama-2-7b-chat-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-chat-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-chat-E8P-2Bit

1

relaxml/Llama-2-70b-chat-E8PRVQ-4Bit

0

relaxml/Llama-2-70b-chat-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-chat-E8PRVQ-4Bit

0

relaxml/Llama-2-13b-chat-E8PRVQ-3Bit

0

Linked in READMEs

Cornell-RelaxML/quip-sharp

606

relaxml/Llama-2-7b-chat-E8P-2Bit

Model

2

stars

5

commits

1

linked in READMEs

Feb 8, 2024

updated

conversational

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Browse cluster: Llama 2 Quantized Model Variants →

Similar repos

relaxml/Llama-2-70b-chat-E8P-2Bit

6

relaxml/Llama-2-7b-chat-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-chat-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-chat-E8P-2Bit

1

relaxml/Llama-2-70b-chat-E8PRVQ-4Bit

0

relaxml/Llama-2-70b-chat-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-chat-E8PRVQ-4Bit

0

relaxml/Llama-2-13b-chat-E8PRVQ-3Bit

0

Linked in READMEs

Cornell-RelaxML/quip-sharp

606

Contributors

5 commits