📚 Introduction

This is the text benchmark for ShizhenGPT, a multimodal LLM for Traditional Chinese Medicine (TCM).

For details, see our paper and GitHub repository.

📊 Benchmark Overview

The benchmark is composed of 7 sections, each compiled from different authoritative TCM illustrated books.

⚒️ Data Construction

{
  "image": [
    "tcm_bench_images/0001.jpg"
  ],
  "question": "请根据这张图片，判断它属于下面哪一种？",
  "options": {
    "A": "巴戟肉",
    "B": "盐巴戟天",
    "C": "制白附子片",
    "D": "生白附子片"
  },
  "answer": "巴戟肉",
  "answer_idx": "A",
  "category": "TCM Patent"
}

📖 Citation

If you find our data useful, please consider citing our work!

@misc{chen2025shizhengptmultimodalllmstraditional,
      title={ShizhenGPT: Towards Multimodal LLMs for Traditional Chinese Medicine}, 
      author={Junying Chen and Zhenyang Cai and Zhiheng Liu and Yunjin Yang and Rongsheng Wang and Qingying Xiao and Xiangyi Feng and Zhan Su and Jing Guo and Xiang Wan and Guangjun Yu and Haizhou Li and Benyou Wang},
      year={2025},
      eprint={2508.14706},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2508.14706},
}