Gaze-based Object Detection in the Wild
원문 초록
In human-robot collaboration, one challenging task is to teach a robot new yet unknown objects enabling it to interact with them. Thereby, gaze can contain valuable information. We investigate if it is possible to detect objects (object or no object) merely from gaze data and determine their bounding box parameters. For this purpose, we explore different sizes of temporal windows, which serve as a basis for the computation of heatmaps, i.e., the spatial distribution of the gaze data. Additionally, we analyze different grid sizes of these heatmaps, and demonstrate the functionality in a proof of concept using different machine learning techniques. Our method is characterized by its speed and resource efficiency compared to conventional object detectors. In order to generate the required data, we conducted a study with five subjects who could move freely and thus, turn towards arbitrary objects. This way, we chose a scenario for our data collection that is as realistic as possible. Since the subjects move while facing objects, the heatmaps also contain gaze data trajectories, complicating the detection and parameter regression. We make our data set publicly available to the research community for download.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Universal Fine-grained Visual Categorization by Concept Guided Learning
Integrity Assessment of Maritime Object Detection Impacted by Partial Camera Obstruction
Ensemble Fusion for Small Object Detection
Small Object Detection for Birds with Swin Transformer
Domain Generalized Object Detection for Remote Sensing Images
Context-Aware Block Net for Small Object Detection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.