🎨 Open-PerfectBlend

Open-PerfectBlend is an open-source reproduction of the instruction dataset introduced in the paper "The Perfect Blend: Redefining RLHF with Mixture of Judges". It's a solid general-purpose instruction dataset with chat, math, code, and instruction-following data.

Data source

Here is the list of the datasets used in this mix:

The deduplication process removed 88.1k samples across all datasets. All of these datasets use either an Apache 2.0 or MIT license.

Thanks to OpenBMB, MetaMath, Hugging Face, Microsoft, theblackcat102, Post-training-Data-Flywheel, and LMSYS for the data!

Comparison

Here is the extract from the paper with the dataset mixture:

There are two main differences with the dataset described in the paper:

• Instruction-following data comes from another source because Meta didn't release their dataset.
• The harmful intent hasn't been released either, so I didn't add any data in this category.