RGB-Multispectral Matching: Dataset, Learning Methodology, Evaluation
원문 초록
We address the problem of registering synchronized color (RGB) and multi-spectral (MS) images featuring very different resolution by solving stereo matching correspondences. Purposely, we introduce a novel RGB-MS dataset framing 13 different scenes in indoor environments and providing a total of 34 image pairs annotated with semi-dense, high-resolution ground-truth labels in the form of disparity maps. To tackle the task, we propose a deep learning architecture trained in a self-supervised manner by exploiting a further RGB camera, required only during training data acquisition. In this setup, we can conveniently learn cross-modal matching in the absence of ground-truth labels by distilling knowledge from an easier RGB-RGB matching task based on a collection of about 11K unlabeled image triplets. Experiments show that the proposed pipeline sets a good performance bar (1.16 pixels average registration error) for future research on this novel, challenging task.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ESMStereo: Enhanced ShuffleMixer Disparity Upsampling for Real-Time and Accurate Stereo Matching
Learning Robust Stereo Matching in the Wild with Selective Mixture-of-Experts
Multi-Label Stereo Matching for Transparent Scene Depth Estimation
Diving into the Fusion of Monocular Priors for Generalized Stereo Matching
Boosting Omnidirectional Stereo Matching with a Pre-trained Depth Foundation Model
Distilling Stereo Networks for Performant and Efficient Leaner Networks
토론
이 논문과 연결된 포럼 글이 아직 없습니다.