PainterNet: Adaptive Image Inpainting with Actual-Token Attention and Diverse Mask Control
원문 초록
Recently, diffusion models have exhibited superior performance in the area of image inpainting. Inpainting methods based on diffusion models can usually generate realistic, high-quality image content for masked areas. However, due to the limitations of diffusion models, existing methods typically encounter problems in terms of semantic consistency between images and text, and the editing habits of users. To address these issues, we present PainterNet, a plugin that can be flexibly embedded into various diffusion models. To generate image content in the masked areas that highly aligns with the user input prompt, we proposed local prompt input, Attention Control Points (ACP), and Actual-Token Attention Loss (ATAL) to enhance the model's focus on local areas. Additionally, we redesigned the MASK generation algorithm in training and testing dataset to simulate the user's habit of applying MASK, and introduced a customized new training dataset, PainterData, and a benchmark dataset, PainterBench. Our extensive experimental analysis exhibits that PainterNet surpasses existing state-of-the-art models in key metrics including image quality and global/local text consistency.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Unsupervised Raindrop Removal from a Single Image using Conditional Diffusion Models
Leveraging Depth Maps and Attention Mechanisms for Enhanced Image Inpainting
Visibility-Uncertainty-guided 3D Gaussian Inpainting via Scene Conceptional Learning
Autoregressive Image Generation with Randomized Parallel Decoding
VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control
Tackling Few-Shot Segmentation in Remote Sensing via Inpainting Diffusion Model
토론
이 논문과 연결된 포럼 글이 아직 없습니다.