AutomatosX/AX-Qwen3-VL-30B-A3B-Instruct-MLX-AXQ-6bit

Model

0

stars

5

commits

1

linked in READMEs

Aug 15, 2026

updated

4-bit
axq
axquant
conversational
image-text-to-text
mlx
moe
qwen3-vl
qwen3_vl_moe
safetensors
vision-language

README

AX-Qwen3-VL-30B-A3B-Instruct-MLX-AXQ-6bit

Development evidence AXQuant mixed-precision pack (not Tier-1 certified). No MTP claim.

FieldValue
SourceQwen/Qwen3-VL-30B-A3B-Instruct@9c4b90e1e4ba969fd3b5378b57d966d725f1b86c
Product class6bit
Measured total BPW6.000054
Convert backendMLX-VLM (affine RTN)
Primary runtimeAX Engine
Compatible runtimeMLX-VLM (vision / image-to-text)
Vision towerProtected BF16
MTPNot present / not claimed
EvidenceArchitecture-prior plan + convert + mlx-vlm image smoke

Use with mlx-vlm

pip install -U mlx-vlm
python -m mlx_vlm.generate --model AutomatosX/AX-Qwen3-VL-30B-A3B-Instruct-MLX-AXQ-6bit \
  --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path.png>

Notes

  • Converted with axquant on Apple Silicon.
  • Sibling Thinking / other VL MoE sizes are not promoted by this pack.
  • AX Engine is the declared primary product runtime; install and load via your AX Engine workflow when available.

Modalities (capability-gated)

Text checkpoint Tier 1 does not imply vision or audio quality. Vision present=true on a pack is not a quality pass.

ModalityClaimSupportedReason
Visionsmoke-certifiedtruevision runtime smoke passed on df-macstudio-m2 (mlx-vlm); quality suite not certified. Evidence: /Users/akiralam/code/axquant/docs/certifications/evidence/modality-recert-macstudio-m2/results/qwen3-vl-30b-axq6.json
Audionot-applicablefalseaudio not supported (no tower config and no sidecar weights)

Contributors

AutomatosX

5 commits

AutomatosX/AX-Qwen3-VL-30B-A3B-Instruct-MLX-AXQ-6bit

Model

0

stars

5

commits

1

linked in READMEs

Aug 15, 2026

updated

4-bit
axq
axquant
conversational
image-text-to-text
mlx
moe
qwen3-vl
qwen3_vl_moe
safetensors
vision-language

README

AX-Qwen3-VL-30B-A3B-Instruct-MLX-AXQ-6bit

Development evidence AXQuant mixed-precision pack (not Tier-1 certified). No MTP claim.

FieldValue
SourceQwen/Qwen3-VL-30B-A3B-Instruct@9c4b90e1e4ba969fd3b5378b57d966d725f1b86c
Product class6bit
Measured total BPW6.000054
Convert backendMLX-VLM (affine RTN)
Primary runtimeAX Engine
Compatible runtimeMLX-VLM (vision / image-to-text)
Vision towerProtected BF16
MTPNot present / not claimed
EvidenceArchitecture-prior plan + convert + mlx-vlm image smoke

Use with mlx-vlm

pip install -U mlx-vlm
python -m mlx_vlm.generate --model AutomatosX/AX-Qwen3-VL-30B-A3B-Instruct-MLX-AXQ-6bit \
  --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path.png>

Notes

  • Converted with axquant on Apple Silicon.
  • Sibling Thinking / other VL MoE sizes are not promoted by this pack.
  • AX Engine is the declared primary product runtime; install and load via your AX Engine workflow when available.

Modalities (capability-gated)

Text checkpoint Tier 1 does not imply vision or audio quality. Vision present=true on a pack is not a quality pass.

ModalityClaimSupportedReason
Visionsmoke-certifiedtruevision runtime smoke passed on df-macstudio-m2 (mlx-vlm); quality suite not certified. Evidence: /Users/akiralam/code/axquant/docs/certifications/evidence/modality-recert-macstudio-m2/results/qwen3-vl-30b-axq6.json
Audionot-applicablefalseaudio not supported (no tower config and no sidecar weights)

Contributors

AutomatosX

5 commits