Overview

This dataset is a continuation of the airoboros-3.1 with the following changes:

• MathJSON has been removed for the time-being, because it seems to confuse the models at times, causing more problems than it's worth. The mathjson dataset can be found here
• The de-censorship data has been re-added, to ensure a non-DPO SFT model using this dataset is relatively uncensored.
• ~11k instructions from slimorca where extended to have an additional, follow-up turn to enhance multi-turn capabilities.

Format

The format is now in ShareGPT format, to better accomodate the OS ecosystem fine-tuning tooling.

Usage restriction

To use this data, you must acknowledge/agree to the following:

• a small sampling of the data contained within is "toxic"/"harmful", and contains profanity and other types of sensitive content
• none of the content or views contained in the dataset necessarily align with my personal beliefs or opinions, they are simply text generated by LLMs without a great amount of validation
• you are able to use the dataset lawfully, particularly in locations with less-than-free speech laws
• you, and you alone are responsible for having downloaded and used the dataset, and I am completely indemnified from any and all liabilities

Also note that the data was generated primarily with gpt-4, and therefore may have some strings attached to the OpenAI terms of service.