This dataset is composed by

• 4,000 examples of argilla/distilabel-capybara-dpo-7k-binarized with chosen score>=4.
• 3,000 examples of argilla/distilabel-intel-orca-dpo-pairs with chosen score>=8.
• 3,000 examples of argilla/ultrafeedback-binarized-preferences-cleaned with chosen score>=4.
• 10,000 examples of wenbopan/Chinese-dpo-pairs.

refer: https://huggingface.co/datasets/hiyouga/DPO-En-Zh-20k 改了question、response_rejected、response_chosen字段，方便ORPO、DPO模型训练时使用

train usage: https://github.com/shibing624/MedicalGPT

Data Length

dpo_zh.jsonl

• 'system' + 'history' + 'question' + 'response_chosen'的平均字符长度: 674
• 'system' + 'history' + 'question' + 'response_chosen'的90%分位数的字符长度: 1279
• 'response_chosen'的平均字符长度: 455.5517
• 'response_chosen'的90%分位数的字符长度: 994.0

dpo_en.jsonl

• 'system' + 'history' + 'question' + 'response_chosen'的平均字符长度: 3268
• 'system' + 'history' + 'question' + 'response_chosen'的90%分位数的字符长度: 7320
• 'response_chosen'的平均字符长度: 1447
• 'response_chosen'的90%分位数的字符长度: 2886