AX Gemma 4 26B A4B IT MLX 6-bit Assistant MTP

Parameter count: approximately 25.81B logical target parameters (the 26B-A4B model class), with approximately 4B active per token. 6-bit is the target quantization precision, not a 6B model-size claim. The separately packaged assistant is not included in the target count.

This is a self-contained MLX model package for Apple Silicon. It combines the Gemma 4 26B-A4B instruction-tuned MoE target with its exact paired Google assistant model for AX Engine multi-token prediction (MTP) / speculative decoding.

The target model verifies every drafted token. The assistant improves decode speed without replacing the target model or changing its output distribution. This repository does not contain PyTorch or GGUF target weights.

Model details

• Base model: google/gemma-4-26B-A4B-it
• MLX target: mlx-community/gemma-4-26b-a4b-it-6bit, revision 5f81a7a6f29e280f4bd5a4ce79d07d7a67fb867b
• Assistant: google/gemma-4-26B-A4B-it-assistant, revision 6e5aaaf4c42b98394530b8fda2e95cadd65c151c
• Architecture: 26B total-parameter, approximately 4B active-parameter MoE
• Format: MLX Safetensors target plus an AX Engine assistant subtree
• Target quantization: 6-bit affine, group size 64; FFN and router projections retain 8-bit overrides
• Assistant precision: upstream unquantized bfloat16 Safetensors
• Configured context length: 262,144 tokens
• MTP pairing: exact
• Maximum packaged draft depth: 1
• Intended hardware: Apple Silicon

The target weight shards and assistant weights are byte-identical to the pinned upstream revisions. AX Engine adds native manifests, an assistant pairing contract, an AX-compatible assistant configuration, and a target-tokenizer copy inside assistant/.

Download

hf download AutomatosX/AX-Gemma-4-26B-A4B-IT-MLX-6bit-Assistant-MTP \
  --local-dir ./AX-Gemma-4-26B-A4B-IT-MLX-6bit-Assistant-MTP

The repository is approximately 22.7 GB. Ensure that the destination has enough free space before downloading.

Use with AX Engine MTP

Install AX Engine, then serve the downloaded repository directory:

ax-engine serve ./AX-Gemma-4-26B-A4B-IT-MLX-6bit-Assistant-MTP --port 31418

Gemma assistant MTP is enabled by default. AX Engine reads ax_gemma4_assistant_mtp.json, loads the compact drafter from assistant/, and uses the 26B-A4B target to verify proposals. Do not load assistant/ by itself as a general-purpose chat model.

The target weights can also be used for direct MLX generation, but the nested assistant acceleration and pairing contract are AX Engine-specific.

Package layout

• model-*.safetensors: 6-bit MLX target weights
• model.safetensors.index.json: target shard index
• assistant/model.safetensors: paired bfloat16 assistant weights
• model-manifest.json and assistant/model-manifest.json: AX native manifests
• ax_gemma4_assistant_mtp.json: exact-pairing and draft-depth contract
• ax_provenance.json: pinned sources and checksums

Validation and provenance

Validated on macOS arm64 with AX Engine 6.9.0 on 2026-07-20:

• AX native artifact validation: ready, with no issues
• All target weight shards: byte-exact against the pinned MLX source
• Assistant weight: byte-exact against the pinned Google assistant source
• Assistant and target tokenizer: byte-identical inside the package
• Pairing contract: exact
• Canonical chat template: pinned from Google Gemma 4 and applied to the target

See ax_provenance.json for immutable source revisions and SHA-256 values.

License

Apache License 2.0. Review the Gemma terms and the original Google model cards for usage limitations and responsible-use guidance.