Instruct Me is a dataset of prompts and instruction dialogues between a human user and AI assistant. The prompts are derived from (prompt, completion) pairs in the Helpful Instructions dataset. The goal is to train a language model to that is "chatty" and can answer the kind of questions or tasks a human user might instruct an AI assistant to perform.
We provide 3 configs that can be used for training RLHF models:
Single-turn user/bot dialogues for instruction tuning.
Prompts to generate model completions and collect human preference data
Prompts to generate model completions for optimization of the instruction-tuned model with techniques like PPO.
v1.1.0 release. Changed the text columns for the reward_modeling and ppo configs to prompt for consistency with our dataset schemas elsewhere.v1.0.0 release.13 commits
Instruct Me is a dataset of prompts and instruction dialogues between a human user and AI assistant. The prompts are derived from (prompt, completion) pairs in the Helpful Instructions dataset. The goal is to train a language model to that is "chatty" and can answer the kind of questions or tasks a human user might instruct an AI assistant to perform.
We provide 3 configs that can be used for training RLHF models:
Single-turn user/bot dialogues for instruction tuning.
Prompts to generate model completions and collect human preference data
Prompts to generate model completions for optimization of the instruction-tuned model with techniques like PPO.
v1.1.0 release. Changed the text columns for the reward_modeling and ppo configs to prompt for consistency with our dataset schemas elsewhere.v1.0.0 release.13 commits