Domain Siamese CNNs for Sparse Multispectral Disparity Estimation
원문 초록
Multispectral disparity estimation is a difficult task for many reasons: it has all the same challenges as traditional visible-visible disparity estimation (occlusions, repetitive patterns, textureless surfaces), in addition of having very few common visual information between images (e.g. color information vs. thermal information). In this paper, we propose a new CNN architecture able to do disparity estimation between images from different spectrum, namely thermal and visible in our case. Our proposed model takes two patches as input and proceeds to do domain feature extraction for each of them. Features from both domains are then merged with two fusion operations, namely correlation and concatenation. These merged vectors are then forwarded to their respective classification heads, which are responsible for classifying the inputs as being same or not. Using two merging operations gives more robustness to our feature extraction process, which leads to more precise disparity estimation. Our method was tested using the publicly available LITIV 2014 and LITIV 2018 datasets, and showed best results when compared to other state of the art methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ESMStereo: Enhanced ShuffleMixer Disparity Upsampling for Real-Time and Accurate Stereo Matching
DispBench: Benchmarking Disparity Estimation to Synthetic Corruptions
DEFOM-Stereo: Depth Foundation Model Based Stereo Matching
ImmersePro: End-to-End Stereo Video Synthesis Via Implicit Disparity Learning
3D-LMVIC: Learning-based Multi-View Image Coding with 3D Gaussian Geometric Priors
Disparity Estimation Using a Quad-Pixel Sensor
토론
이 논문과 연결된 포럼 글이 아직 없습니다.