On the Robustness of Normalizing Flows for Inverse Problems in Imaging
원문 초록
Conditional normalizing flows can generate diverse image samples for solving inverse problems. Most normalizing flows for inverse problems in imaging employ the conditional affine coupling layer that can generate diverse images quickly. However, unintended severe artifacts are occasionally observed in the output of them. In this work, we address this critical issue by investigating the origins of these artifacts and proposing the conditions to avoid them. First of all, we empirically and theoretically reveal that these problems are caused by "exploding inverse" in the conditional affine coupling layer for certain out-of-distribution (OOD) conditional inputs. Then, we further validated that the probability of causing erroneous artifacts in pixels is highly correlated with a Mahalanobis distance-based OOD score for inverse problems in imaging. Lastly, based on our investigations, we propose a remark to avoid exploding inverse and then based on it, we suggest a simple remedy that substitutes the affine coupling layers with the modified rational quadratic spline coupling layers in normalizing flows, to encourage the robustness of generated image samples. Our experimental results demonstrated that our suggested methods effectively suppressed critical artifacts occurring in normalizing flows for super-resolution space generation and low-light image enhancement.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
HVI-CIDNet+: Beyond Extreme Darkness for Low-Light Image Enhancement
RT-X Net: RGB-Thermal cross attention network for Low-Light Image Enhancement
URWKV: Unified RWKV Model with Multi-state Perspective for Low-light Image Restoration
See through the Dark: Learning Illumination-affined Representations for Nighttime Occupancy Prediction
Degradation-Aware Feature Perturbation for All-in-One Image Restoration
Entropy-Driven Genetic Optimization for Deep-Feature-Guided Low-Light Image Enhancement
토론
이 논문과 연결된 포럼 글이 아직 없습니다.