turboderp/GLM-5.3-Flash-exl3

Model

EXL3 quants of GLM-5.3-Flash

48

7 commits

1 linked in READMEs

updated Aug 28, 2026

See the code

README

EXL3 quants of GLM-5.3-Flash

⚠️ Requires ExLlamaV3 v1.4.5 (or dev branch)

Plain quants:

2.05 bits per weight
3.05 bits per weight
4.05 bits per weight

Self-calibrated quants and more benchmarks to follow

qbsg_kld_spread qb_kld qbsg_kld_hist_combined

exl3