Shadowgraph
TrendingAbout
Sign in

Dongz/llama31-405b-quant

Model

Quantization version of meta-llama/Meta-Llama-3.1-405B.

1

3 commits

1 linked in READMEs

updated Sep 24, 2024

See the code

README

Quantization version of meta-llama/Meta-Llama-3.1-405B.

safetensors

Contributors

Dongz

3 commits

Similar repos

leafspark/Meta-Llama-3.1-405B-Instruct-GGUF

Model

Meta-Llama-3.1-405B-Instruct-GGUF

21

squeeze-ai-lab/sq-llama-30b-w4-s0

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

1

squeeze-ai-lab/sq-llama-30b-w3-s45

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

1

squeeze-ai-lab/sq-llama-30b-w4-s5

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

0

Jundot/Qwen3.8-27B-oQ4e-fp16-mtp

Model

Qwen3.8-27B-oQ4e-fp16-mtp

9

squeeze-ai-lab/sq-llama-30b-w3-s0

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

4

squeeze-ai-lab/sq-llama-30b-w4-s45

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

0

squeeze-ai-lab/sq-llama-30b-w3-s5

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

0

Linked in READMEs

ModelTC/LightCompress

[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and…

749

README badge

Dongz/llama31-405b-quant

Model

Quantization version of meta-llama/Meta-Llama-3.1-405B.

1

3 commits

1 linked in READMEs

updated Sep 24, 2024

See the code

README

Quantization version of meta-llama/Meta-Llama-3.1-405B.

safetensors

Similar repos

leafspark/Meta-Llama-3.1-405B-Instruct-GGUF

Model

Meta-Llama-3.1-405B-Instruct-GGUF

21

squeeze-ai-lab/sq-llama-30b-w4-s0

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

1

squeeze-ai-lab/sq-llama-30b-w3-s45

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

1

squeeze-ai-lab/sq-llama-30b-w4-s5

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

0

Jundot/Qwen3.8-27B-oQ4e-fp16-mtp

Model

Qwen3.8-27B-oQ4e-fp16-mtp

9

squeeze-ai-lab/sq-llama-30b-w3-s0

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

4

squeeze-ai-lab/sq-llama-30b-w4-s45

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

0

squeeze-ai-lab/sq-llama-30b-w3-s5

Model

SqueezeLLM is a post-training quantization framework that incorporates a new method called…

0

Linked in READMEs

ModelTC/LightCompress

[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and…

749

README badge

Contributors

Dongz

3 commits