0
stars
5
commits
2
linked in READMEs
Sep 4, 2026
updated
README
Qwen2.5-0.5B-Instruct — CoreML (ANE+GPU Optimized)
Converted from Qwen/Qwen2.5-0.5B-Instruct for on-device inference on Apple devices.
| File | Size | Description |
|---|---|---|
model.mlpackage | 302 MB | Monolithic decoder with stateful KV cache (int4) |
- HF-exact match: "The capital of France is Paris." ✅
- iOS 18+ required (MLState API)
See CoreML-LLM for full details.
More models in this format: Core ML Model Zoo — 46 models, each with the recipe that produced it.
Want a different model on-device? Open a request — free, open weights only; the export and its measured numbers get published publicly.
Contributors
5 commits
Similar repos
0
stars
5
commits
2
linked in READMEs
Sep 4, 2026
updated
README
Qwen2.5-0.5B-Instruct — CoreML (ANE+GPU Optimized)
Converted from Qwen/Qwen2.5-0.5B-Instruct for on-device inference on Apple devices.
| File | Size | Description |
|---|---|---|
model.mlpackage | 302 MB | Monolithic decoder with stateful KV cache (int4) |
- HF-exact match: "The capital of France is Paris." ✅
- iOS 18+ required (MLState API)
See CoreML-LLM for full details.
More models in this format: Core ML Model Zoo — 46 models, each with the recipe that produced it.
Want a different model on-device? Open a request — free, open weights only; the export and its measured numbers get published publicly.
Similar repos
Linked in READMEs
Contributors
5 commits