SJ-Donald/orca-dpo-pairs-ko

SJ-Donald/orca-dpo-pairs-ko is merged dataset from fllow datasets

Datasets

• mncai/orca_dpo_pairs_ko
• Ja-ck/Orca-DPO-Pairs-KO
• We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs

Merge datasets from above and drop duplicates.

How to use

from datasets import load_dataset

ds = load_dataset("SJ-Donald/orca-dpo-pairs-ko")
print(ds)

DatasetDict({
    train: Dataset({
        features: ['system', 'question', 'chosen', 'rejected'],
        num_rows: 36009
    })
})