Silent Branding Attack: Trigger-free Data Poisoning Attack on Text-to-Image Diffusion Models
원문 초록
Text-to-image diffusion models have achieved remarkable success in generating high-quality contents from text prompts. However, their reliance on publicly available data and the growing trend of data sharing for fine-tuning make these models particularly vulnerable to data poisoning attacks. In this work, we introduce the Silent Branding Attack, a novel data poisoning method that manipulates text-to-image diffusion models to generate images containing specific brand logos or symbols without any text triggers. We find that when certain visual patterns are repeatedly in the training data, the model learns to reproduce them naturally in its outputs, even without prompt mentions. Leveraging this, we develop an automated data poisoning algorithm that unobtrusively injects logos into original images, ensuring they blend naturally and remain undetected. Models trained on this poisoned dataset generate images containing logos without degrading image quality or text alignment. We experimentally validate our silent branding attack across two realistic settings on large-scale high-quality image datasets and style personalization datasets, achieving high success rates even without a specific text trigger. Human evaluation and quantitative metrics including logo detection show that our method can stealthily embed logos.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Addressing The Devastating Effects Of Single-Task Data Poisoning In Exemplar-Free Continual Learning
VLMs Can Aggregate Scattered Training Patches
Does Low Rank Adaptation Lead to Lower Robustness against Training-Time Attacks?
Adversarial Robustness of Deep Learning Models for Inland Water Body Segmentation from SAR Images
Data Poisoning in Deep Learning: A Survey
Keeping up with dynamic attackers: Certifying robustness to adaptive online data poisoning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.