Averaging Spatio-temporal Signals using Optimal Transport and Soft Alignments
원문 초록
Several fields in science, from genomics to neuroimaging, require monitoring populations (measures) that evolve with time. These complex datasets, describing dynamics with both time and spatial components, pose new challenges for data analysis. We propose in this work a new framework to carry out averaging of these datasets, with the goal of synthesizing a representative template trajectory from multiple trajectories. We show that this requires addressing three sources of invariance: shifts in time, space, and total population size (or mass/amplitude). Here we draw inspiration from dynamic time warping (DTW), optimal transport (OT) theory and its unbalanced extension (UOT) to propose a criterion that can address all three issues. This proposal leverages a smooth formulation of DTW (Soft-DTW) that is shown to capture temporal shifts, and UOT to handle both variations in space and size. Our proposed loss can be used to define spatio-temporal barycenters as Fr\'echet means. Using Fenchel duality, we show how these barycenters can be computed efficiently, in parallel, via a novel variant of entropy-regularized debiased UOT. Experiments on handwritten letters and brain imaging data confirm our theoretical findings and illustrate the effectiveness of the proposed loss for spatio-temporal data.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ActAlign: Zero-Shot Fine-Grained Video Classification via Language-Guided Sequence Alignment
TimePoint: Accelerated Time Series Alignment via Self-Supervised Keypoint and Descriptor Learning
Semi-Supervised Image-Based Narrative Extraction: A Case Study with Historical Photographic Records
Automatic Differentiation-based Full Waveform Inversion with Flexible Workflows
Contrast Similarity-Aware Dual-Pathway Mamba for Multivariate Time Series Node Classification
Multiscale Dubuc: A New Similarity Measure for Time Series
토론
이 논문과 연결된 포럼 글이 아직 없습니다.