7 repos
MajkelDcember/MS_Thesis
No description
0
1 commits
RanchiZhao/AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
5
764 commits
qwopqwop200/GPTQ-for-LLaMa
4 bits quantization of LLaMA using GPTQ
3,070
473 commits
Cornell-RelaxML/quip-sharp
608
46 commits
IST-DASLab/gptq
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained…
2,375
32 commits
facebookresearch/any4
Quantize transformers to any learned arbitrary 4-bit numeric format
59
143 commits
cnygaard/glq
Lattice and trellis-coded quantization for LLM weights — 2–8 bpw, mixed-precision, fused CUDA…
8
487 commits
