relaxml/Llama-2-70b-E8P-2Bit

Model

3

stars

5

commits

1

linked in READMEs

Feb 8, 2024

updated

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Browse cluster: Llama 2 Quantized Model Variants →

Contributors

3 commits

2 commits

Similar repos

relaxml/Llama-2-7b-E8P-2Bit

1

relaxml/Llama-2-70b-E8PRVQ-4Bit

0

relaxml/Llama-2-70b-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-E8P-2Bit

2

relaxml/Llama-2-7b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-E8PRVQ-4Bit

0

relaxml/Llama-2-70b-chat-E8P-2Bit

6

Linked in READMEs

Cornell-RelaxML/quip-sharp

606

relaxml/Llama-2-70b-E8P-2Bit

Model

3

stars

5

commits

1

linked in READMEs

Feb 8, 2024

updated

endpoints_compatible

llama

safetensors

text-generation

text-generation-inference

transformers

Browse cluster: Llama 2 Quantized Model Variants →

Similar repos

relaxml/Llama-2-7b-E8P-2Bit

1

relaxml/Llama-2-70b-E8PRVQ-4Bit

0

relaxml/Llama-2-70b-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-E8P-2Bit

2

relaxml/Llama-2-7b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8PRVQ-3Bit

0

relaxml/Llama-2-13b-E8PRVQ-4Bit

0

relaxml/Llama-2-70b-chat-E8P-2Bit

6

Linked in READMEs

Cornell-RelaxML/quip-sharp

606

Contributors

3 commits

2 commits