AutomatosX/AX-DeepSeek-OCR-2-MLX-AXQ-6bit

Model

0

stars

3

commits

1

linked in READMEs

Aug 13, 2026

updated

6-bit
axq
axquant
conversational
deepseek
deepseekocr_2
development
image-text-to-text
mlx
mlx-vlm
ocr
safetensors
vision

README

AX-DeepSeek-OCR-2-MLX-AXQ-6bit

Development AXQuant (AXQ) 6-bit language MLX pack of deepseek-ai/DeepSeek-OCR-2 @ aaa02f3811945a91062062994c5c4a3f4c0af2b0.

Language experts/attention/MLP at 6-bit; vision towers BF16-preserved. Total BPW includes large BF16 vision (policy minimum ~8.3 when 4-bit is excluded).

Converted via MLX-VLM deepseekocr_2 from mlx-community/DeepSeek-OCR-2-bf16 @ 9946f9ac306378a3e6a86cad7d7f8be8e536f092.

Claims

ClaimStatus
AXQuant architecture-prior / development quantYes
OCR accuracy / document-bench scoresNot claimed
Vision optimizationNo — SAM + Qwen2 encoder + projector BF16-preserved
Certified releaseNo

Attribution

Base weights © DeepSeek AI (Apache-2.0). Quantization by AXQuant (development).

Contributors

AutomatosX

3 commits

AutomatosX/AX-DeepSeek-OCR-2-MLX-AXQ-6bit

Model

0

stars

3

commits

1

linked in READMEs

Aug 13, 2026

updated

6-bit
axq
axquant
conversational
deepseek
deepseekocr_2
development
image-text-to-text
mlx
mlx-vlm
ocr
safetensors
vision

README

AX-DeepSeek-OCR-2-MLX-AXQ-6bit

Development AXQuant (AXQ) 6-bit language MLX pack of deepseek-ai/DeepSeek-OCR-2 @ aaa02f3811945a91062062994c5c4a3f4c0af2b0.

Language experts/attention/MLP at 6-bit; vision towers BF16-preserved. Total BPW includes large BF16 vision (policy minimum ~8.3 when 4-bit is excluded).

Converted via MLX-VLM deepseekocr_2 from mlx-community/DeepSeek-OCR-2-bf16 @ 9946f9ac306378a3e6a86cad7d7f8be8e536f092.

Claims

ClaimStatus
AXQuant architecture-prior / development quantYes
OCR accuracy / document-bench scoresNot claimed
Vision optimizationNo — SAM + Qwen2 encoder + projector BF16-preserved
Certified releaseNo

Attribution

Base weights © DeepSeek AI (Apache-2.0). Quantization by AXQuant (development).

Contributors

AutomatosX

3 commits