Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
원문 초록
Human motion prediction aims to generate future motions based on the observed human motions. Witnessing the success of Recurrent Neural Networks (RNN) in modeling the sequential data, recent works utilize RNN to model human-skeleton motion on the observed motion sequence and predict future human motions. However, these methods did not consider the existence of the spatial coherence among joints and the temporal evolution among skeletons, which reflects the crucial characteristics of human motion in spatiotemporal space. To this end, we propose a novel Skeleton-joint Co-attention Recurrent Neural Networks (SC-RNN) to capture the spatial coherence among joints, and the temporal evolution among skeletons simultaneously on a skeleton-joint co-attention feature map in spatiotemporal space. First, a skeleton-joint feature map is constructed as the representation of the observed motion sequence. Second, we design a new Skeleton-joint Co-Attention (SCA) mechanism to dynamically learn a skeleton-joint co-attention feature map of this skeleton-joint feature map, which can refine the useful observed motion information to predict one future motion. Third, a variant of GRU embedded with SCA collaboratively models the human-skeleton motion and human-joint motion in spatiotemporal space by regarding the skeleton-joint co-attention feature map as the motion context. Experimental results on human motion prediction demonstrate the proposed method outperforms the related methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Temporal Continual Learning with Prior Compensation for Human Motion Prediction
Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristic
Multi-Resolution Haar Network: Enhancing human motion prediction via Haar transform
Multi-Transmotion: Pre-trained Model for Human Motion Prediction
Learning Semantic Latent Directions for Accurate and Controllable Human Motion Prediction
A Mixture of Experts Approach to 3D Human Motion Prediction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.