Hercules-v4.0

Data Source Description

Hercules-v4.0 is an extensive and diverse dataset that combines various domains to create a powerful tool for training artificial intelligence models. The data sources include conversations, coding examples, scientific explanations, and more. The dataset is sourced from multiple high-quality repositories, each contributing to the robustness of Hercules-v4.0 in different knowledge domains.

Included Data Sources

• OpenOrca/SlimOrca
• Evol Instruct 70K & 140K
• teknium/GPT4-LLM-Cleaned
• jondurbin/airoboros-3.2
• AlekseyKorshuk/camel-chatml
• CollectiveCognition/chats-data-2023-09-22
• Lmsys chat 1m GPT-4 generations only.
• glaiveai/glaive-code-assistant
• glaiveai/glaive-function-calling-v2
• garage-bAInd/Open-Platypus
• meta-math/MetaMathQA
• microsoft/orca-math-word-problems-200k
• GPTeacher roleplay datasets
• BI55/MedText
• Various medical datasets by CogStack
• Unnatural Instructions
• abacusai/SystemChat
• m-a-p/Code-Feedback
• totally-not-an-llm/EverythingLM-data-V3
• Locutusque/arc-cot
• FuseAI/FuseChat-Mixture
• LDJnr/Pure-Dove
• teknium/trismegistus-project
• Vezora/Tested-22k-Python-Alpaca
• Crystalcareai/alpaca-gpt4-COT
• grimulkan/theory-of-mind
• CollectiveCognition/chats-data-2023-09-27
• CollectiveCognition/chats-data-2023-10-16
• NobodyExistsOnTheInternet/sharegptPIPPA
• sablo/oasst2_curated

Data Characteristics

The dataset amalgamates text from various domains, including structured and unstructured data. It contains dialogues, instructional texts, scientific explanations, coding tasks, and more.

Intended Use

Hercules-v4.0 is designed for training and evaluating AI models capable of handling complex tasks across multiple domains. It is suitable for researchers and developers in academia and industry working on advanced conversational agents, instruction-following models, and knowledge-intensive applications.

Data Quality

The data was collected from reputable sources with an emphasis on diversity and quality. It is expected to be relatively clean but may require additional preprocessing for specific tasks.

Limitations and Bias

• The dataset may have inherent biases from the original data sources.
• Some domains may be overrepresented due to the nature of the source datasets.

X-rated Content Disclaimer

Hercules-v4.0 contains X-rated content. Users are solely responsible for the use of the dataset and must ensure that their use complies with all applicable laws and regulations. The dataset maintainers are not responsible for the misuse of the dataset.

Usage Agreement

By using the Hercules-v4.0 dataset, users agree to the following:

• The dataset is used at the user's own risk.
• The dataset maintainers are not liable for any damages arising from the use of the dataset.
• Users will not hold the dataset maintainers responsible for any claims, liabilities, losses, or expenses.

Please make sure to read the license for more information.