Shadowgraph
TrendingAbout
Sign in
← Explore by area/Quantized LLM Model Distribution

Cluster 650470

35 repos

4-bit ·604
gptq ·599
transformers ·597
safetensors ·582
text-generation ·568
text-generation-inference ·469
llama ·405
en ·339
custom_code ·153
conversational ·149

Related clusters

Llama Language Models30Cluster 6504697Mistral-based Text Generation Models35German Language LLM Models19Qwen Large Language Models28Quantized LLM Model Optimization39

TheBloke/speechless-mistral-moloras-7B-GPTQ

Model

Speechless Mistral Moloras 7B - GPTQ

1

4 commits

TheBloke/airoboros-m-7B-3.1.2-dare-0.85-GPTQ

Model

Airoboros M 7B 3.1.2 Dare 0.85 - GPTQ

0

4 commits

TheBloke/speechless-mistral-7B-dare-0.85-GPTQ

Model

Speechless Mistral 7B Dare 0.85 - GPTQ

2

4 commits

TheBloke/SynthIA-7B-v1.3-dare-0.85-GPTQ

Model

Synthia 7B V1.3 Dare 0.85 - GPTQ

1

4 commits

TheBloke/CollectiveCognition-v1.1-Mistral-7B-dare-0.85-GPTQ

Model

Collectivecognition V1.1 Mistral 7B Dare 0.85 - GPTQ

1

4 commits

TheBloke/wizardLM-7B-GPTQ

Model

WizardLM's WizardLM-7B 4bit GPTQ

106

62 commits

TheBloke/orca_mini_7B-GPTQ

Model

Pankaj Mathur's Orca Mini 7B GPTQ

12

13 commits

TheBloke/MythoMax-L2-13B-GPTQ

Model

MythoMax L2 13B - GPTQ

220

21 commits

TheBloke/open-llama-13b-open-instruct-GPTQ

Model

VMWare's OpenLlama 13B Open Instruct GPTQ

10

13 commits

TheBloke/em_german_mistral_v01-GPTQ

Model

EM German Mistral v01 - GPTQ

5

4 commits

openbmb/MiniCPM4-0.5B-QAT-Int4-GPTQ-format

Model

👋 Join us on Discord and WeChat

3

4 commits

openbmb/MiniCPM4.1-8B-GPTQ

Model

👋 Contact us in Discord and WeChat

1

9 commits

TheBloke/em_german_leo_mistral-GPTQ

Model

EM German Leo Mistral - GPTQ

10

4 commits

openbmb/MiniCPM4-8B-marlin-Eagle-vLLM

Model

👋 Join us on Discord and WeChat

7

6 commits

openbmb/MiniCPM4-8B-Eagle-FRSpec-QAT

Model

👋 Join us on Discord and WeChat

12

8 commits

openbmb/MiniCPM-4.1-8B-Marlin

Model

👋 Contact us in Discord and WeChat

2

11 commits

tencent/Hunyuan-A13B-Instruct-GPTQ-Int4

Model

🤗 Hugging Face  |  

53

42 commits

OV

AIDC-AI/Ovis2-34B-GPTQ-Int4

Model

Ovis2-34B-GPTQ-Int4

8

4 commits

OV

AIDC-AI/Ovis1.6-Llama3.2-3B-GPTQ-Int4

Model

Ovis1.6-Llama3.2-3B-GPTQ-Int4

4

9 commits

OV

AIDC-AI/Ovis1.6-Gemma2-9B-GPTQ-Int4

Model

Ovis1.6-Gemma2-9B-GPTQ-Int4

9

17 commits

TheBloke/CodeLlama-7B-Instruct-GPTQ

Model

CodeLlama 7B Instruct - GPTQ

47

38 commits

Qwen/Qwen1.5-32B-Chat-GPTQ-Int4

Model

Qwen1.5-32B-Chat-GPTQ-Int4

32

11 commits

baichuan-inc/Baichuan-M2-32B-GPTQ-Int4

Model

Baichuan-M2-32B-GPTQ-Int4

12

10 commits

TheBloke/calm2-7B-chat-GPTQ

Model

Calm2 7B Chat - GPTQ

5

8 commits

Qwen/Qwen2.5-Omni-7B-GPTQ-Int4

Model

Qwen2.5-Omni-7B-GPTQ-Int4

16

5 commits

openbmb/MiniCPM-V-4.6-GPTQ

Model

> **This repository hosts the GPTQ (W4A16, GPTQModel) quantized version of [MiniCPM-V…

3

6 commits

openbmb/MiniCPM-V-4.6-Thinking-GPTQ

Model

> **This repository hosts the GPTQ (W4A16, GPTQModel) quantized version of [MiniCPM-V 4.6…

4

7 commits

alexwww94/glm-4v-9b-gptq-4bit

Model

Metrics

7

20 commits

mattbucci/gemma-4-21B-REAP-AWQ

Model

Gemma 4 21B REAP AWQ 4-bit (thinking + vision + video)

0

3 commits

mattbucci/Qwen3.8-27B-AWQ

Model

Qwen3.8-27B-AWQ (INT4 W4A16)

6

2 commits

TheBloke/speechless-mistral-7B-dare-0.85-AWQ

Model

Speechless Mistral 7B Dare 0.85 - AWQ

1

4 commits

TheBloke/airoboros-m-7B-3.1.2-dare-0.85-AWQ

Model

Airoboros M 7B 3.1.2 Dare 0.85 - AWQ

0

4 commits

TheBloke/speechless-mistral-moloras-7B-AWQ

Model

Speechless Mistral Moloras 7B - AWQ

3

7 commits

TheBloke/CollectiveCognition-v1.1-Mistral-7B-dare-0.85-AWQ

Model

Collectivecognition V1.1 Mistral 7B Dare 0.85 - AWQ

1

4 commits

TheBloke/SynthIA-7B-v1.3-dare-0.85-AWQ

Model

Synthia 7B V1.3 Dare 0.85 - AWQ

0

4 commits