HuatuoGPT2-Pretraining-Instruction-5200K

Here are the pre-training instructions for HuatuoGPT-II, developed with 5.2 million medical corpus using ChatGPT.

This dataset is used to incorporate extensive medical knowledge and enable a one-stage medical adaptation. All our data have been made publicly accessible.

Data Volume

The following table details the volume and distribution of pre-training data for HuatuoGPT2:

Repository

• Github: https://github.com/FreedomIntelligence/HuatuoGPT-II

Citations

@misc{chen2023huatuogptii,
      title={HuatuoGPT-II: One-Stage Training for Medical Adaptation of Large Language Models}, 
      author={Junying Chen, Xidong Wang, Anningzhe Gao, Feng Jiang, Shunian Chen, Hongbo Zhang, Dingjie Song, Wenya Xie, Chuyi Kong, Jianquan Li, Xiang Wan, Haizhou Li, and Benyou Wang},
      year={2023},
      eprint={2311.09774},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

@article{huatuogpt-2023,
  title={HuatuoGPT: Pioneering the Integration of Medical Expertise into Language Models},
  author={Hongbo Zhang, Junying Chen, Feng Jiang, Fei Yu, Zhihong Chen, Jianquan Li, Guiming Chen, Xiangbo Wu, Zhiyi Zhang, Qingying Xiao, Xiang Wan, Benyou Wang, and Haizhou Li},
  journal={arXiv preprint arXiv:2305.15075},
  year={2023}
}