Derived from HuggingFaceTB/SmolLM2-135M-Instruct: same weights, ONNX
graph re-exported with per-layer attention-probability outputs
(attentions.0 … attentions.29) alongside logits and the KV cache,
for in-browser attention visualization in
Tsumugi.
Also exposes the embedding lookup as inputs_embeds ([batch, seq, 576]),
and ships geometry/ — exact top-12 cosine neighbours, a PCA-64 int8 copy of
the embedding table, decoded token texts and a manifest — for the Embeddings
card in Tsumugi.
Validation (see validation-report.json): logits parity with the stock
export, row-stochastic causal attention rows, cached-vs-full-matrix
equivalence.
Variants: onnx/model_quantized.onnx (dynamic int8, dtype: 'q8',
with /lm_head/MatMul excluded from quantization) is the sole published
variant: it is greedy-token-identical to the stock fp32 export on the
validation prompts — better than the official stock q4, which diverges
at step 4. q4 and fp16 variants were produced and deliberately withheld
(q4: on par with stock q4 but strictly worse than this q8; fp16:
computes incorrectly on the WebGPU execution provider despite loading).
4 commits
Derived from HuggingFaceTB/SmolLM2-135M-Instruct: same weights, ONNX
graph re-exported with per-layer attention-probability outputs
(attentions.0 … attentions.29) alongside logits and the KV cache,
for in-browser attention visualization in
Tsumugi.
Also exposes the embedding lookup as inputs_embeds ([batch, seq, 576]),
and ships geometry/ — exact top-12 cosine neighbours, a PCA-64 int8 copy of
the embedding table, decoded token texts and a manifest — for the Embeddings
card in Tsumugi.
Validation (see validation-report.json): logits parity with the stock
export, row-stochastic causal attention rows, cached-vs-full-matrix
equivalence.
Variants: onnx/model_quantized.onnx (dynamic int8, dtype: 'q8',
with /lm_head/MatMul excluded from quantization) is the sole published
variant: it is greedy-token-identical to the stock fp32 export on the
validation prompts — better than the official stock q4, which diverges
at step 4. q4 and fp16 variants were produced and deliberately withheld
(q4: on par with stock q4 but strictly worse than this q8; fp16:
computes incorrectly on the WebGPU execution provider despite loading).
4 commits