Self-Supervised Depth Completion for Active Stereo
원문 초록
Active stereo systems are used in many robotic applications that require 3D information. These depth sensors, however, suffer from stereo artefacts and do not provide dense depth estimates.In this work, we present the first self-supervised depth completion method for active stereo systems that predicts accurate dense depth maps. Our system leverages a feature-based visual inertial SLAM system to produce motion estimates and accurate (but sparse) 3D landmarks. The 3D landmarks are used both as model input and as supervision during training. The motion estimates are used in our novel reconstruction loss that relies on a combination of passive and active stereo frames, resulting in significant improvements in textureless areas that are common in indoor environments. Due to the nonexistence of publicly available active stereo datasets, we release a real dataset together with additional information for a publicly available synthetic dataset (TartanAir [42]) needed for active depth completion and prediction. Through rigorous evaluations we show that our method outperforms state of the art on both datasets. Additionally we show how our method obtains more complete, and therefore safer, 3D maps when used in a robotic platform.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
PacGDC: Label-Efficient Generalizable Depth Completion with Projection Ambiguity and Consistency
DEPTHOR: Depth Enhancement from a Practical Light-Weight dToF Sensor and RGB Image
Vanishing Depth: A Depth Adapter with Positional Depth Encoding for Generalized Image Encoders
SVDC: Consistent Direct Time-of-Flight Video Depth Completion with Frequency Selective Fusion
TranSplat: Surface Embedding-guided 3D Gaussian Splatting for Transparent Object Manipulation
TDCNet: Transparent Objects Depth Completion with CNN-Transformer Dual-Branch Parallel Network
토론
이 논문과 연결된 포럼 글이 아직 없습니다.