Degradation-agnostic Correspondence from Resolution-asymmetric Stereo
원문 초록
In this paper, we study the problem of stereo matching from a pair of images with different resolutions, e.g., those acquired with a tele-wide camera system. Due to the difficulty of obtaining ground-truth disparity labels in diverse real-world systems, we start from an unsupervised learning perspective. However, resolution asymmetry caused by unknown degradations between two views hinders the effectiveness of the generally assumed photometric consistency. To overcome this challenge, we propose to impose the consistency between two views in a feature space instead of the image space, named feature-metric consistency. Interestingly, we find that, although a stereo matching network trained with the photometric loss is not optimal, its feature extractor can produce degradation-agnostic and matching-specific features. These features can then be utilized to formulate a feature-metric loss to avoid the photometric inconsistency. Moreover, we introduce a self-boosting strategy to optimize the feature extractor progressively, which further strengthens the feature-metric consistency. Experiments on both simulated datasets with various degradations and a self-collected real-world dataset validate the superior performance of the proposed method over existing solutions.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ESMStereo: Enhanced ShuffleMixer Disparity Upsampling for Real-Time and Accurate Stereo Matching
Learning Robust Stereo Matching in the Wild with Selective Mixture-of-Experts
Multi-Label Stereo Matching for Transparent Scene Depth Estimation
Diving into the Fusion of Monocular Priors for Generalized Stereo Matching
Boosting Omnidirectional Stereo Matching with a Pre-trained Depth Foundation Model
Distilling Stereo Networks for Performant and Efficient Leaner Networks
토론
이 논문과 연결된 포럼 글이 아직 없습니다.