FCFR-Net: Feature Fusion based Coarse-to-Fine Residual Learning for Depth Completion
원문 초록
Depth completion aims to recover a dense depth map from a sparse depth map with the corresponding color image as input. Recent approaches mainly formulate depth completion as a one-stage end-to-end learning task, which outputs dense depth maps directly. However, the feature extraction and supervision in one-stage frameworks are insufficient, limiting the performance of these approaches. To address this problem, we propose a novel end-to-end residual learning framework, which formulates the depth completion as a two-stage learning task, i.e., a sparse-to-coarse stage and a coarse-to-fine stage. First, a coarse dense depth map is obtained by a simple CNN framework. Then, a refined depth map is further obtained using a residual learning strategy in the coarse-to-fine stage with a coarse depth map and color image as input. Specially, in the coarse-to-fine stage, a channel shuffle extraction operation is utilized to extract more representative features from the color image and coarse depth map, and an energy based fusion operation is exploited to effectively fuse these features obtained by channel shuffle operation, thus leading to more accurate and refined depth maps. We achieve SoTA performance in RMSE on KITTI benchmark. Extensive experiments on other datasets future demonstrate the superiority of our approach over current state-of-the-art depth completion approaches.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
PacGDC: Label-Efficient Generalizable Depth Completion with Projection Ambiguity and Consistency
DEPTHOR: Depth Enhancement from a Practical Light-Weight dToF Sensor and RGB Image
Vanishing Depth: A Depth Adapter with Positional Depth Encoding for Generalized Image Encoders
SVDC: Consistent Direct Time-of-Flight Video Depth Completion with Frequency Selective Fusion
TranSplat: Surface Embedding-guided 3D Gaussian Splatting for Transparent Object Manipulation
TDCNet: Transparent Objects Depth Completion with CNN-Transformer Dual-Branch Parallel Network
토론
이 논문과 연결된 포럼 글이 아직 없습니다.