A Flexible Framework for Virtual Omnidirectional Vision to Improve Operator Situation Awareness
원문 초록
During teleoperation of a mobile robot, providing good operator situation awareness is a major concern as a single mistake can lead to mission failure. Camera streams are widely used for teleoperation but offer limited field-of-view. In this paper, we present a flexible framework for virtual projections to increase situation awareness based on a novel method to fuse multiple cameras mounted anywhere on the robot. Moreover, we propose a complementary approach to improve scene understanding by fusing camera images and geometric 3D Lidar data to obtain a colorized point cloud. The implementation on a compact omnidirectional camera reduces system complexity considerably and solves multiple use-cases on a much smaller footprint compared to traditional approaches such as actuated pan-tilt units. Finally, we demonstrate the generality of the approach by application to the multi-camera system of the Boston Dynamics Spot. The software implementation is available as open-source ROS packages on the project page https://tu-darmstadt-ros-pkg.github.io/omnidirectional_vision.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Learning to Tune Like an Expert: Interpretable and Scene-Aware Navigation via MLLM Reasoning and CVAE-Based Adaptation
OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understanding
Feed-Forward SceneDINO for Unsupervised Semantic Scene Completion
SIU3R: Simultaneous Scene Understanding and 3D Reconstruction Beyond Feature Alignment
SurgTPGS: Semantic 3D Surgical Scene Understanding with Text Promptable Gaussian Splatting
ReME: A Data-Centric Framework for Training-Free Open-Vocabulary Segmentation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.