Towards Disentangled Representations for Human Retargeting by Multi-view Learning
원문 초록
We study the problem of learning disentangled representations for data across multiple domains and its applications in human retargeting. Our goal is to map an input image to an identity-invariant latent representation that captures intrinsic factors such as expressions and poses. To this end, we present a novel multi-view learning approach that leverages various data sources such as images, keypoints, and poses. Our model consists of multiple id-conditioned VAEs for different views of the data. During training, we encourage the latent embeddings to be consistent across these views. Our observation is that auxiliary data like keypoints and poses contain critical, id-agnostic semantic information, and it is easier to train a disentangling CVAE on these simpler views to separate such semantics from other id-specific attributes. We show that training multi-view CVAEs and encourage latent-consistency guides the image encoding to preserve the semantics of expressions and poses, leading to improved disentangled representations and better human retargeting results.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Reliable Disentanglement Multi-view Learning Against View Adversarial Attacks
Multi-View Learning with Context-Guided Receptance for Image Denoising
Molecule Generation for Target Protein Binding with Hierarchical Consistency Diffusion Model
Balanced Multi-view Clustering
Missing Data as Augmentation in the Earth Observation Domain: A Multi-View Learning Approach
OpenViewer: Openness-Aware Multi-View Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.