Jailbreak Classification

Dataset Summary

Dataset used to classify prompts as jailbreak vs. benign.

Dataset Structure

Data Fields

• prompt: an LLM prompt
• type: classification label, either jailbreak or benign

Dataset Creation

Curation Rationale

Created to help detect & prevent harmful jailbreak prompts when users interact with LLMs.

Source Data

Jailbreak prompts sourced from: https://github.com/verazuo/jailbreak_llms

Benign prompts sourced from:

• OpenOrca
• https://github.com/teknium1/GPTeacher