README
StackExchange Paired
This is a processed version of the HuggingFaceH4/stack-exchange-preferences. The following steps were applied:
- Parse HTML to Markdown with
markdownify - Create pairs
(response_j, response_k)where j was rated better than k - Sample at most 10 pairs per question
- Shuffle the dataset globally
This dataset is designed to be used for preference learning. The processing notebook is in the repository as well.
Contributors
lvwerra
7 commits
Similar repos
README
StackExchange Paired
This is a processed version of the HuggingFaceH4/stack-exchange-preferences. The following steps were applied:
- Parse HTML to Markdown with
markdownify - Create pairs
(response_j, response_k)where j was rated better than k - Sample at most 10 pairs per question
- Shuffle the dataset globally
This dataset is designed to be used for preference learning. The processing notebook is in the repository as well.
Similar repos
Linked in READMEs
Contributors
lvwerra
7 commits