Self-Guided Instance-Aware Network for Depth Completion and Enhancement
원문 초록
Depth completion aims at inferring a dense depth image from sparse depth measurement since glossy, transparent or distant surface cannot be scanned properly by the sensor. Most of existing methods directly interpolate the missing depth measurements based on pixel-wise image content and the corresponding neighboring depth values. Consequently, this leads to blurred boundaries or inaccurate structure of object. To address these problems, we propose a novel self-guided instance-aware network (SG-IANet) that: (1) utilize self-guided mechanism to extract instance-level features that is needed for depth restoration, (2) exploit the geometric and context information into network learning to conform to the underlying constraints for edge clarity and structure consistency, (3) regularize the depth estimation and mitigate the impact of noise by instance-aware learning, and (4) train with synthetic data only by domain randomization to bridge the reality gap. Extensive experiments on synthetic and real world dataset demonstrate that our proposed method outperforms previous works. Further ablation studies give more insights into the proposed method and demonstrate the generalization capability of our model.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DEPTHOR: Depth Enhancement from a Practical Light-Weight dToF Sensor and RGB Image
DCIRNet: Depth Completion with Iterative Refinement for Dexterous Grasping of Transparent and Reflective Objects
BadDepth: Backdoor Attacks Against Monocular Depth Estimation in the Physical World
Depth Anything with Any Prior
GAA-TSO: Geometry-Aware Assisted Depth Completion for Transparent and Specular Objects
Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors
토론
이 논문과 연결된 포럼 글이 아직 없습니다.