Shadowgraph
TrendingAbout
Sign in
← Explore by area/Quantized LLM Model Deployment

Cluster 647070

2 repos

Python · 1
post-training-quantization ·2
python ·2
mlx ·2
model-compression ·2
apple-silicon ·2
edge-ai ·2
llm ·2
machine-learning ·2
mixed-precision ·2
quantization ·2

Related clusters

Quantized LLM Model Optimization39Cluster 63525931Cluster 64707330Apple Silicon LLM Quantization9Qwen Model Quantization & Optimization15Quantized MLX Model Deployments6

AutomatosX/AX-Qwen3.8-27B-MLX-AXQ-8bit-MTP

Model

AX-Qwen3.8-27B-MLX-AXQ-8bit-MTP — 8.63 BPW measured main

0

6 commits

defai-digital/axquant

Not another flat 4-bit quantizer. AXQuant mixes precision layer by layer for Apple Silicon—smaller…

Python

2

340 commits