← Explore by area/GGUF Model Quantization & Deployment

Cluster 639558

13 repos

conversational ·406

endpoints_compatible ·406

gguf ·406

imatrix ·406

image-text-to-text ·246

text-generation ·56

ik_llama.cpp ·44

step3p5 ·44

quantized ·17

speculative-decoding ·14

Related clusters

LLM Quantization and ROCm Optimization38 GGUF quantized LLM models23 Text-to-Speech & GGUF Model Variants14 GGUF quantized language models36 Cluster 6395565 Quantized LLM Model Optimization39

bartowski/google_gemma-4-31B-it-GGUF

Llamacpp imatrix Quantizations of gemma-4-31B-it by google

91

103 commits

bartowski/google_gemma-4-26B-A4B-it-GGUF

Llamacpp imatrix Quantizations of gemma-4-26B-A4B-it by google

155

98 commits

AngelSlim/Hy4-preview-GGUF

Hy4-preview GGUF

96

15 commits

mradermacher/QoQ-Med-VL-7B-i1-GGUF

About

0

29 commits

ubergarm/Step-3.5-Flash-GGUF

`ik_llama.cpp` imatrix Quantizations of stepfun-ai/Step-3.5-Flash

44

21 commits

Farggin/Lobo-Qwen3.8-27B-GSQ-RCO-IQ3_S-MTP-GGUF

Lobo Qwen3.8-27B GSQ-RCO IQ3_S + MTP GGUF

3

2 commits

pugant/Qwen3.8-27B-imatrix

Importance matrix (imatrix) for Qwen3.8-27B

0

8 commits

SixVolts/Qwen3.5-122B-A10B-Opus-Reasoning-MTP-GGUF

Qwen3.5-122B-A10B-Opus-Reasoning — Dynamic imatrix GGUF + MTP draft

8

16 commits

jackasda211233/Hy3-IQ4_NL-GGUF

Tencent Hy3 (HunYuan-3) — IQ4_NL GGUF

0

6 commits

Baekpica/Motif-3-Mixed-Quant-GGUF

Motif 3 — Mixed-Quant GGUF

3

35 commits

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

🧰 1. Files & comparison

1

1 commits

pearsonkyle/Qwopus3.6-27B-Coder-2bit-MTP-GGUF

🧰 1. Files & comparison

5

1 commits

mradermacher/Nous-Hermes-2-Mistral-7B-DPO-i1-GGUF

About

0

29 commits