Leveraging RGB-D Data with Cross-Modal Context Mining for Glass Surface Detection
원문 초록
Glass surfaces are becoming increasingly ubiquitous as modern buildings tend to use a lot of glass panels. This, however, poses substantial challenges to the operations of autonomous systems such as robots, self-driving cars, and drones, as these glass panels can become transparent obstacles to navigation. Existing works attempt to exploit various cues, including glass boundary context or reflections, as priors. However, they are all based on input RGB images. We observe that the transmission of 3D depth sensor light through glass surfaces often produces blank regions in the depth maps, which can offer additional insights to complement the RGB image features for glass surface detection. In this work, we first propose a large-scale RGB-D glass surface detection dataset, \textit{RGB-D GSD}, for rigorous experiments and future research. It contains 3,009 images, paired with precise annotations, offering a wide range of real-world RGB-D glass surface categories. We then propose a novel glass surface detection framework combining RGB and depth information, with two novel modules: a cross-modal context mining (CCM) module to adaptively learn individual and mutual context features from RGB and depth information, and a depth-missing aware attention (DAA) module to explicitly exploit spatial locations where missing depths occur to help detect the presence of glass surfaces. Experimental results show that our proposed model outperforms state-of-the-art methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Representation Improvement in Latent Space for Search-Based Testing of Autonomous Robotic Systems
On Learning Informative Trajectory Embeddings for Imitation, Classification and Regression
COOOL: Challenge Of Out-Of-Label A Novel Benchmark for Autonomous Driving
CARLA2Real: a tool for reducing the sim2real gap in CARLA simulator
Context-Aware Full Body Anonymization using Text-to-Image Diffusion Models
Accurate Automatic 3D Annotation of Traffic Lights and Signs for Autonomous Driving
토론
이 논문과 연결된 포럼 글이 아직 없습니다.