AceReason-1.1-SFT

AceReason-1.1-SFT is a diverse and high-quality supervised fine-tuning (SFT) dataset focused on math and code reasoning. It serves as the SFT training data for AceReason-Nemotron-1.1-7B, with all responses in the dataset generated by DeepSeek-R1.

AceReason-1.1-SFT contains 2,668,741 math samples and 1,301,591 code samples, covering the data sources from OpenMathReasoning, NuminaMath-CoT, OpenCodeReasoning, MagicoderEvolInstruct, opc-sft-stage2, leetcode, TACO, and apps. We conduct data decontamination and filter the sample that has a 9-gram overlap with any test sample in our math and coding benchmarks. For more details, check our technical report.

The following are the statistics for AceReason-1.1-SFT.

Correspondence to

Zihan Liu (zihanl@nvidia.com), Zhuolin Yang (zhuoliny@nvidia.com), Yang Chen (yachen@nvidia.com), Chankyu Lee (chankyul@nvidia.com), Wei Ping (wping@nvidia.com)

License

This dataset is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0) available at https://creativecommons.org/licenses/by/4.0/legalcode.

Intended Usage

The AceReason-1.1-SFT Dataset only contains math and code reasoning data, without any general general-domain or non-reasoning samples. It is specifically designed for training SFT models focused on math and code reasoning.

Release Date

June 16, 2025

Ethical Considerations

NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.

Please report security vulnerabilities or NVIDIA AI Concerns here.

Citation

@article{liu2025acereason,
  title={AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergy},
  author={Liu, Zihan and Yang, Zhuolin and Chen, Yang and Lee, Chankyu and Shoeybi, Mohammad and Catanzaro, Bryan and Ping, Wei},
  journal={arXiv preprint arXiv:2506.13284},
  year={2025}
}