squeeze-ai-lab/sq-llama-2-7b-w4-s0

Model

0

5 commits

1 linked in READMEs

updated Oct 4, 2023

endpoints_compatible

llama

text-generation

transformers

Contributors

4 commits

1 commits

Similar repos

squeeze-ai-lab/sq-llama-2-7b-w3-s0

0

squeeze-ai-lab/sq-llama-2-13b-w4-s0

4

squeeze-ai-lab/sq-llama-2-13b-w3-s0

0

relaxml/Llama-2-70b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8P-2Bit

1

relaxml/Llama-2-70b-E8P-2Bit

3

relaxml/Llama-2-70b-E8PRVQ-3Bit

0

Linked in READMEs

SqueezeAILab/SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

723

squeeze-ai-lab/sq-llama-2-7b-w4-s0

Model

0

5 commits

1 linked in READMEs

updated Oct 4, 2023

endpoints_compatible

llama

text-generation

transformers

Similar repos

squeeze-ai-lab/sq-llama-2-7b-w3-s0

0

squeeze-ai-lab/sq-llama-2-13b-w4-s0

4

squeeze-ai-lab/sq-llama-2-13b-w3-s0

0

relaxml/Llama-2-70b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8PRVQ-4Bit

0

relaxml/Llama-2-7b-E8P-2Bit

1

relaxml/Llama-2-70b-E8P-2Bit

3

relaxml/Llama-2-70b-E8PRVQ-3Bit

0

Linked in READMEs

SqueezeAILab/SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

723

Contributors

4 commits

1 commits