Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformer
원문 초록
Multi-person interactive motion generation, a critical yet under-explored domain in computer character animation, poses significant challenges such as intricate modeling of inter-human interactions beyond individual motions and generating two motions with huge differences from one text condition. Current research often employs separate module branches for individual motions, leading to a loss of interaction information and increased computational demands. To address these challenges, we propose a novel, unified approach that models multi-person motions and their interactions within a single latent space. Our approach streamlines the process by treating interactive motions as an integrated data point, utilizing a Variational AutoEncoder (VAE) for compression into a unified latent space, and performing a diffusion process within this space, guided by the natural language conditions. Experimental results demonstrate our method's superiority over existing approaches in generation quality, performing text condition in particular when motions have significant asymmetry, and accelerating the generation efficiency while preserving high quality.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarios
EPFL-Smart-Kitchen-30: Densely annotated cooking dataset with 3D kinematics to challenge video and language models
MMGT: Motion Mask Guided Two-Stage Network for Co-Speech Gesture Video Generation
Wav2Sem: Plug-and-Play Audio Semantic Decoupling for 3D Speech-Driven Facial Animation
SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing
A Survey on Human Interaction Motion Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.