Forbidden Question Dataset (160)
Forbidden_Questions_CJA 설명 보기
Here is the forbidden question dataset (based on two previous works), it contains 160 questions from 160 violated categories. In addition, authors also provide the corresponding target -- which is useful for some jailbreak methods, such as GCG.