Can Action be Imitated? Learn to Reconstruct and Transfer Human Dynamics from Videos
원문 초록
Given a video demonstration, can we imitate the action contained in this video? In this paper, we introduce a novel task, dubbed mesh-based action imitation. The goal of this task is to enable an arbitrary target human mesh to perform the same action shown on the video demonstration. To achieve this, a novel Mesh-based Video Action Imitation (M-VAI) method is proposed by us. M-VAI first learns to reconstruct the meshes from the given source image frames, then the initial recovered mesh sequence is fed into mesh2mesh, a mesh sequence smooth module proposed by us, to improve the temporal consistency. Finally, we imitate the actions by transferring the pose from the constructed human body to our target identity mesh. High-quality and detailed human body meshes can be generated by using our M-VAI. Extensive experiments demonstrate the feasibility of our task and the effectiveness of our proposed method.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Survey on Human Interaction Motion Generation
ST-MoE-BERT: A Spatial-Temporal Mixture-of-Experts Framework for Long-Term Cross-City Mobility Prediction
CityBench: Evaluating the Capabilities of Large Language Models for Urban Tasks
Paths of A Million People: Extracting Life Trajectories from Wikipedia
SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model
Dynamic Spatial-Temporal Aggregation for Skeleton-Aware Sign Language Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.