Secrets of Edge-Informed Contrast Maximization for Event-Based Vision
원문 초록
Event cameras capture the motion of intensity gradients (edges) in the image plane in the form of rapid asynchronous events. When accumulated in 2D histograms, these events depict overlays of the edges in motion, consequently obscuring the spatial structure of the generating edges. Contrast maximization (CM) is an optimization framework that can reverse this effect and produce sharp spatial structures that resemble the moving intensity gradients by estimating the motion trajectories of the events. Nonetheless, CM is still an underexplored area of research with avenues for improvement. In this paper, we propose a novel hybrid approach that extends CM from uni-modal (events only) to bi-modal (events and edges). We leverage the underpinning concept that, given a reference time, optimally warped events produce sharp gradients consistent with the moving edge at that time. Specifically, we formalize a correlation-based objective to aid CM and provide key insights into the incorporation of multiscale and multireference techniques. Moreover, our edge-informed CM method yields superior sharpness scores and establishes new state-of-the-art event optical flow benchmarks on the MVSEC, DSEC, and ECD datasets.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
V2V: Scaling Event-Based Vision through Efficient Video-to-Voxel Simulation
eCARLA-scenes: A synthetically generated dataset for event-based optical flow prediction
EvRepSL: Event-Stream Representation via Self-Supervised Learning for Event-Based Vision
eStonefish-scenes: A synthetically generated dataset for underwater event-based optical flow prediction tasks
Towards Mobile Sensing with Event Cameras on High-agility Resource-constrained Devices: A Survey
Event-based vision for egomotion estimation using precise event timing
토론
이 논문과 연결된 포럼 글이 아직 없습니다.