Oscillation Inversion: Understand the structure of Large Flow Model through the Lens of Inversion Method
원문 초록
We explore the oscillatory behavior observed in inversion methods applied to large-scale text-to-image diffusion models, with a focus on the "Flux" model. By employing a fixed-point-inspired iterative approach to invert real-world images, we observe that the solution does not achieve convergence, instead oscillating between distinct clusters. Through both toy experiments and real-world diffusion models, we demonstrate that these oscillating clusters exhibit notable semantic coherence. We offer theoretical insights, showing that this behavior arises from oscillatory dynamics in rectified flow models. Building on this understanding, we introduce a simple and fast distribution transfer technique that facilitates image enhancement, stroke-based recoloring, as well as visual prompt-guided image editing. Furthermore, we provide quantitative results demonstrating the effectiveness of our method for tasks such as image enhancement, makeup transfer, reconstruction quality, and guided sampling quality. Higher-quality examples of videos and images are available at \href{https://yanyanzheng96.github.io/oscillation_inversion/}{this link}.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
HVI-CIDNet+: Beyond Extreme Darkness for Low-Light Image Enhancement
MAC-Lookup: Multi-Axis Conditional Lookup Model for Underwater Image Enhancement
Learning to See in the Extremely Dark
RT-X Net: RGB-Thermal cross attention network for Low-Light Image Enhancement
URWKV: Unified RWKV Model with Multi-state Perspective for Low-light Image Restoration
See through the Dark: Learning Illumination-affined Representations for Nighttime Occupancy Prediction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.