Wait, but Tylenol is Acetaminophen... Investigating and Improving Language Models' Ability to Resist Requests for Misinformation
원문 초록
Background: Large language models (LLMs) are trained to follow directions, but this introduces a vulnerability to blindly comply with user requests even if they generate wrong information. In medicine, this could accelerate the generation of misinformation that impacts human well-being. Objectives/Methods: We analyzed compliance to requests to generate misleading content about medications in settings where models know the request is illogical. We investigated whether in-context directions and instruction-tuning of LLMs to prioritize logical reasoning over compliance reduced misinformation risk. Results: While all frontier LLMs complied with misinformation requests, both prompt-based and parameter-based approaches can improve the detection of logic flaws in requests and prevent the dissemination of medical misinformation. Conclusion: Shifting LLMs to prioritize logic over compliance could reduce risks of exploitation for medical misinformation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CRAVE: A Conflicting Reasoning Approach for Explainable Claim Verification Using LLMs
Remember Past, Anticipate Future: Learning Continual Multimodal Misinformation Detectors
Robustness of Misinformation Classification Systems to Adversarial Examples Through BeamAttack
Persona-Assigned Large Language Models Exhibit Human-Like Motivated Reasoning
SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
토론
이 논문과 연결된 포럼 글이 아직 없습니다.