clef-text-0.6b

A 0.70B-parameter text decision model distilled from Cloudflare's clef-flash (9B): Qwen3-0.6B (LoRA merged) + Clef's joint schema head. Same Jev / SystemOne contract: one probability per option of every typed question, one forward pass. Good at routing and classification; not a knowledge model (see the table).

Apple silicon / Neural Engine build: FluidInference/clef-text-0.6b-coreml.

Usage

joint_schema_model.py is Cloudflare's unchanged Clef module (record encoding, head, ClefModel).

import json, sys, torch
from huggingface_hub import snapshot_download
from safetensors.torch import load_file
from transformers import AutoModelForCausalLM, AutoTokenizer

path = snapshot_download("FluidInference/clef-text-0.6b")
sys.path.insert(0, path)
from joint_schema_model import ClefModel, JointSchemaHead, collate_records, encode_record

tokenizer = AutoTokenizer.from_pretrained(path)
backbone = AutoModelForCausalLM.from_pretrained(path, dtype=torch.float32)
head = JointSchemaHead(**json.loads(open(f"{path}/joint_head_config.json").read()))
head.load_state_dict(load_file(f"{path}/joint_head.safetensors"))
model = ClefModel(backbone, head).eval()

record = {"state": "Our checkout is down and customers can't pay.",
          "questions": {"team": {"type": "choice", "instructions": "Which team should handle this?",
                                 "criteria": {"billing": "Payments", "engineering": "Bugs or outages"}},
                        "urgency": {"type": "score", "criteria": ["Low", "Normal", "High", "Critical"]}}}
encoded = encode_record(tokenizer, record)
with torch.inference_mode():
    logits = model(collate_records([encoded], tokenizer.pad_token_id, torch.device("cpu")))[0]
for question, question_logits in zip(encoded.questions, logits):
    print(question.question_id, dict(zip(question.option_ids, question_logits.softmax(-1).tolist())))

Quality (held-out test splits, gold accuracy)

Training: 24,208 records from 12 public datasets (train splits) labelled by clef-flash, KL (T = 2) + 0.3 gold CE, LoRA r64 + full head, 2 epochs on an M5 Pro.

License and credits

Apache-2.0. joint_schema_model.py and LICENSE are Cloudflare's (Apache-2.0). Teacher Cloudflare/clef-flash; base Qwen/Qwen3-0.6B. By Fluid Inference.