relaxml/Llama-2-13b-E8PRVQ-4Bit

Model

0

stars

4

commits

1

linked in READMEs

Feb 8, 2024

updated

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Browse cluster: Llama 2 Quantized Model Variants →

Contributors

4 commits

Similar repos

relaxml/Llama-2-13b-E8PRVQ-3Bit

0

relaxml/Llama-2-7b-E8PRVQ-4Bit

0

relaxml/Llama-2-13b-E8P-2Bit

2

relaxml/Llama-2-70b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8PRVQ-3Bit

0

relaxml/Llama-2-70b-E8PRVQ-3Bit

0

relaxml/Llama-2-7b-E8P-2Bit

1

relaxml/Llama-2-70b-E8P-2Bit

3

Linked in READMEs

Cornell-RelaxML/quip-sharp

606

relaxml/Llama-2-13b-E8PRVQ-4Bit

Model

0

stars

4

commits

1

linked in READMEs

Feb 8, 2024

updated

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Browse cluster: Llama 2 Quantized Model Variants →

Similar repos

relaxml/Llama-2-13b-E8PRVQ-3Bit

0

relaxml/Llama-2-7b-E8PRVQ-4Bit

0

relaxml/Llama-2-13b-E8P-2Bit

2

relaxml/Llama-2-70b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8PRVQ-3Bit

0

relaxml/Llama-2-70b-E8PRVQ-3Bit

0

relaxml/Llama-2-7b-E8P-2Bit

1

relaxml/Llama-2-70b-E8P-2Bit

3

Linked in READMEs

Cornell-RelaxML/quip-sharp

606

Contributors

4 commits