Image Generation from Contextually-Contradictory Prompts
원문 초록
Text-to-image diffusion models excel at generating high-quality, diverse images from natural language prompts. However, they often fail to produce semantically accurate results when the prompt contains concept combinations that contradict their learned priors. We define this failure mode as contextual contradiction, where one concept implicitly negates another due to entangled associations learned during training. To address this, we propose a stage-aware prompt decomposition framework that guides the denoising process using a sequence of proxy prompts. Each proxy prompt is constructed to match the semantic content expected to emerge at a specific stage of denoising, while ensuring contextual coherence. To construct these proxy prompts, we leverage a large language model (LLM) to analyze the target prompt, identify contradictions, and generate alternative expressions that preserve the original intent while resolving contextual conflicts. By aligning prompt information with the denoising progression, our method enables fine-grained semantic control and accurate image generation in the presence of contextual contradictions. Experiments across a variety of challenging prompts show substantial improvements in alignment to the textual prompt.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
MFGDiffusion: Mask-Guided Smoke Synthesis for Enhanced Forest Fire Detection
ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
fastWDM3D: Fast and Accurate 3D Healthy Tissue Inpainting
CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-step
Programmable-Room: Interactive Textured 3D Room Meshes Generation Empowered by Large Language Models
Stochastic Solutions for Simultaneous Seismic Data Denoising and Reconstruction via Score-based Generative Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.