记录量化LLM中的总结。
Python
79
58 commits
updated Jan 8, 2026
配套文章:
pprp/Awesome-LLM-Quantization
Awesome list for LLM quantization
448
AI-Efficiency/Awesome-Model-Quantization
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering…
2,450
Kai-Liu001/Awesome-Model-Quantization
This repository contains low-bit quantization papers from 2020 to 2026 on top conference.
222
Zhen-Dong/Awesome-Quantization-Papers
List of papers related to neural network quantization in recent AI conferences and journals.
855
HuangOwen/Awesome-LLM-Compression
Awesome LLM compression research papers and tools.
1,879
caiovicentino/eoq-quantization
EOQ: Entropy-Optimal Quantization for LLMs. 11-41% smaller than GGUF Q4_K_M with near-FP16…
46
vllm-project/llm-compressor
State-of-the-art LLM compression, built for production inference with vLLM
3,823
Cornell-RelaxML/quip-sharp
609
97.0%
Cuda
2.5%