Forecasting People Trajectories and Head Poses by Jointly Reasoning on Tracklets and Vislets
원문 초록
In this work, we explore the correlation between people trajectories and their head orientations. We argue that people trajectory and head pose forecasting can be modelled as a joint problem. Recent approaches on trajectory forecasting leverage short-term trajectories (aka tracklets) of pedestrians to predict their future paths. In addition, sociological cues, such as expected destination or pedestrian interaction, are often combined with tracklets. In this paper, we propose MiXing-LSTM (MX-LSTM) to capture the interplay between positions and head orientations (vislets) thanks to a joint unconstrained optimization of full covariance matrices during the LSTM backpropagation. We additionally exploit the head orientations as a proxy for the visual attention, when modeling social interactions. MX-LSTM predicts future pedestrians location and head pose, increasing the standard capabilities of the current approaches on long-term trajectory forecasting. Compared to the state-of-the-art, our approach shows better performances on an extensive set of public benchmarks. MX-LSTM is particularly effective when people move slowly, i.e. the most challenging scenario for all other models. The proposed approach also allows for accurate predictions on a longer time horizon.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ECAM: A Contrastive Learning Approach to Avoid Environmental Collision in Trajectory Forecasting
Egocentric Event-Based Vision for Ping Pong Ball Trajectory Prediction
Multi-modal Knowledge Distillation-based Human Trajectory Forecasting
Controllable Motion Generation via Diffusion Modal Coupling
EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Driving in the Arab Gulf Region
TrajFlow: A Generative Framework for Occupancy Density Estimation Using Normalizing Flows
토론
이 논문과 연결된 포럼 글이 아직 없습니다.