Toxic-DPO

This is a highly toxic, "harmful" dataset meant to illustrate how DPO can be used to de-censor/unalign a model quite easily using direct-preference-optimization (DPO) using very few examples.

Many of the examples still contain some amount of warnings/disclaimers, so it's still somewhat editorialized.

Usage restriction

To use this data, you must acknowledge/agree to the following:

• data contained within is "toxic"/"harmful", and contains profanity and other types of sensitive content
• none of the content or views contained in the dataset necessarily align with my personal beliefs or opinions, they are simply text generated by LLMs automatically
• you are able to use the dataset lawfully, particularly in locations with less-than-free speech laws
• you, and you alone are responsible for having downloaded and used the dataset, and I am completely indemnified from any and all liabilities

This dataset is meant exclusively for academic/research or other non-nefarious use-cases.