REDEditing: Relationship-Driven Precise Backdoor Poisoning on Text-to-Image Diffusion Models
원문 초록
The rapid advancement of generative AI highlights the importance of text-to-image (T2I) security, particularly with the threat of backdoor poisoning. Timely disclosure and mitigation of security vulnerabilities in T2I models are crucial for ensuring the safe deployment of generative models. We explore a novel training-free backdoor poisoning paradigm through model editing, which is recently employed for knowledge updating in large language models. Nevertheless, we reveal the potential security risks posed by model editing techniques to image generation models. In this work, we establish the principles for backdoor attacks based on model editing, and propose a relationship-driven precise backdoor poisoning method, REDEditing. Drawing on the principles of equivalent-attribute alignment and stealthy poisoning, we develop an equivalent relationship retrieval and joint-attribute transfer approach that ensures consistent backdoor image generation through concept rebinding. A knowledge isolation constraint is proposed to preserve benign generation integrity. Our method achieves an 11\% higher attack success rate compared to state-of-the-art approaches. Remarkably, adding just one line of code enhances output naturalness while improving backdoor stealthiness by 24\%. This work aims to heighten awareness regarding this security vulnerability in editable image generation models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation
Evaluating Attribute Confusion in Fashion Text-to-Image Generation
Programmable-Room: Interactive Textured 3D Room Meshes Generation Empowered by Large Language Models
Decoupled Classifier-Free Guidance for Counterfactual Diffusion Models
Fair Generation without Unfair Distortions: Debiasing Text-to-Image Generation with Entanglement-Free Attention
MFGDiffusion: Mask-Guided Smoke Synthesis for Enhanced Forest Fire Detection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.