relaxml/Llama-2-7b-E8P-2Bit

Model

1

stars

5

commits

1

linked in READMEs

Feb 8, 2024

updated

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Browse cluster: Llama 2 Quantized Model Variants →

Contributors

3 commits

2 commits

Similar repos

relaxml/Llama-2-70b-E8P-2Bit

3

relaxml/Llama-2-13b-E8P-2Bit

2

relaxml/Llama-2-7b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8PRVQ-3Bit

0

relaxml/Llama-2-70b-E8PRVQ-4Bit

0

relaxml/Llama-2-70b-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-E8PRVQ-4Bit

0

relaxml/Llama-2-13b-E8PRVQ-3Bit

0

Linked in READMEs

Cornell-RelaxML/quip-sharp

606

relaxml/Llama-2-7b-E8P-2Bit

Model

1

stars

5

commits

1

linked in READMEs

Feb 8, 2024

updated

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Browse cluster: Llama 2 Quantized Model Variants →

Similar repos

relaxml/Llama-2-70b-E8P-2Bit

3

relaxml/Llama-2-13b-E8P-2Bit

2

relaxml/Llama-2-7b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8PRVQ-3Bit

0

relaxml/Llama-2-70b-E8PRVQ-4Bit

0

relaxml/Llama-2-70b-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-E8PRVQ-4Bit

0

relaxml/Llama-2-13b-E8PRVQ-3Bit

0

Linked in READMEs

Cornell-RelaxML/quip-sharp

606

Contributors

3 commits

2 commits