osunlp/QUEST-30B-MT-Plus-SFT

Model

QUEST-30B-MT+SFT

1

10 commits

1 linked in READMEs

updated May 26, 2026

See the code

README

QUEST-30B-MT+SFT

QUEST 30B checkpoint after mid-training + SFT (Qwen3-30B-A3B base, dense). This is an intermediate artifact in the QUEST 30B training pipeline (MT β†’ SFT β†’ RL).

We did not run benchmark evaluations on this checkpoint. For full pipeline results, see QUEST-30B-RL.

Training stage

StageApplied
Mid-training (MT)βœ“
Supervised fine-tuning (SFT)βœ“
Reinforcement learning (RL)βœ—

QUEST Family

TypeResources
35B checkpointsRL, MT+SFT, MT, SFT
30B checkpointsRL, MT+SFT, SFT
Smaller checkpoints9B, 4B, 2B
Training dataRL data, SFT objective data, SFT open-ended data, Mid-training data

Model selection note: if you only need to evaluate objective tasks and do not need open-ended task evaluation, we recommend the MT+SFT checkpoints because they perform better on reasoning-heavy objective benchmarks. For a more comprehensive evaluation across both objective and open-ended tasks, we recommend the RL checkpoints.

Quick start

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "osunlp/QUEST-30B-MT-Plus-SFT"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id, device_map="auto", torch_dtype="auto",
)

License

Released under the Apache License 2.0.

Citation

If our paper or related resources prove valuable to your research, we kindly ask for a citation.

@misc{xie2026quest,
  title={QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks},
  author={Xie, Jian and Lin, Tianhe and Wang, Zilu and Ning, Yuting and Yao, Yuekun and Xue, Tianci and Zhang, Zhehao and Li, Zhongyang and Zhang, Kai and Wu, Yufan and Chen, Shijie and Gou, Boyu and Han, Mingzhe and Wang, Yifei and Lee, Vint and Wei, Xinpeng and Wang, Xiangjun and Su, Yu and Sun, Huan},
  journal={arXiv preprint arXiv:2605.24218},
  year={2026}
}
conversational
endpoints_compatible
quest
qwen3_moe
safetensors
text-generation
transformers

Contributors

hsaest

10 commits

osunlp/QUEST-30B-MT-Plus-SFT

Model

QUEST-30B-MT+SFT

1

10 commits

1 linked in READMEs

updated May 26, 2026

See the code

README

QUEST-30B-MT+SFT

QUEST 30B checkpoint after mid-training + SFT (Qwen3-30B-A3B base, dense). This is an intermediate artifact in the QUEST 30B training pipeline (MT β†’ SFT β†’ RL).

We did not run benchmark evaluations on this checkpoint. For full pipeline results, see QUEST-30B-RL.

Training stage

StageApplied
Mid-training (MT)βœ“
Supervised fine-tuning (SFT)βœ“
Reinforcement learning (RL)βœ—

QUEST Family

TypeResources
35B checkpointsRL, MT+SFT, MT, SFT
30B checkpointsRL, MT+SFT, SFT
Smaller checkpoints9B, 4B, 2B
Training dataRL data, SFT objective data, SFT open-ended data, Mid-training data

Model selection note: if you only need to evaluate objective tasks and do not need open-ended task evaluation, we recommend the MT+SFT checkpoints because they perform better on reasoning-heavy objective benchmarks. For a more comprehensive evaluation across both objective and open-ended tasks, we recommend the RL checkpoints.

Quick start

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "osunlp/QUEST-30B-MT-Plus-SFT"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id, device_map="auto", torch_dtype="auto",
)

License

Released under the Apache License 2.0.

Citation

If our paper or related resources prove valuable to your research, we kindly ask for a citation.

@misc{xie2026quest,
  title={QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks},
  author={Xie, Jian and Lin, Tianhe and Wang, Zilu and Ning, Yuting and Yao, Yuekun and Xue, Tianci and Zhang, Zhehao and Li, Zhongyang and Zhang, Kai and Wu, Yufan and Chen, Shijie and Gou, Boyu and Han, Mingzhe and Wang, Yifei and Lee, Vint and Wei, Xinpeng and Wang, Xiangjun and Su, Yu and Sun, Huan},
  journal={arXiv preprint arXiv:2605.24218},
  year={2026}
}
conversational
endpoints_compatible
quest
qwen3_moe
safetensors
text-generation
transformers

Contributors

hsaest

10 commits