Detecting Engagement in Egocentric Video
원문 초록
In a wearable camera video, we see what the camera wearer sees. While this makes it easy to know roughly what he chose to look at, it does not immediately reveal when he was engaged with the environment. Specifically, at what moments did his focus linger, as he paused to gather more information about something he saw? Knowing this answer would benefit various applications in video summarization and augmented reality, yet prior work focuses solely on the "what" question (estimating saliency, gaze) without considering the "when" (engagement). We propose a learning-based approach that uses long-term egomotion cues to detect engagement, specifically in browsing scenarios where one frequently takes in new visual information (e.g., shopping, touring). We introduce a large, richly annotated dataset for ego-engagement that is the first of its kind. Our approach outperforms a wide array of existing methods. We show engagement can be detected well independent of both scene appearance and the camera wearer's identity.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SD-VSum: A Method and Dataset for Script-Driven Video Summarization
An Egocentric Vision-Language Model based Portable Real-time Smart Assistant
What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations
Do Language Models Understand Time?
Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark
Does SpatioTemporal information benefit Two video summarization benchmarks?
토론
이 논문과 연결된 포럼 글이 아직 없습니다.