3DMotion-Net: Learning Continuous Flow Function for 3D Motion Prediction
원문 초록
In this paper, we deal with the problem to predict the future 3D motions of 3D object scans from previous two consecutive frames. Previous methods mostly focus on sparse motion prediction in the form of skeletons. While in this paper we focus on predicting dense 3D motions in the from of 3D point clouds. To approach this problem, we propose a self-supervised approach that leverages the power of the deep neural network to learn a continuous flow function of 3D point clouds that can predict temporally consistent future motions and naturally bring out the correspondences among consecutive point clouds at the same time. More specifically, in our approach, to eliminate the unsolved and challenging process of defining a discrete point convolution on 3D point cloud sequences to encode spatial and temporal information, we introduce a learnable latent code to represent the temporal-aware shape descriptor which is optimized during model training. Moreover, a temporally consistent motion Morpher is proposed to learn a continuous flow field which deforms a 3D scan from the current frame to the next frame. We perform extensive experiments on D-FAUST, SCAPE and TOSCA benchmark data sets and the results demonstrate that our approach is capable of handling temporally inconsistent input and produces consistent future 3D motion while requiring no ground truth supervision.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Temporal Continual Learning with Prior Compensation for Human Motion Prediction
Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristic
Autoregression-free video prediction using diffusion model for mitigating error propagation
APEX: Empowering LLMs with Physics-Based Task Planning for Real-time Insight
Multi-Resolution Haar Network: Enhancing human motion prediction via Haar transform
AGI-Elo: How Far Are We From Mastering A Task?
토론
이 논문과 연결된 포럼 글이 아직 없습니다.