Generative Adversarial Talking Head: Bringing Portraits to Life with a Weakly Supervised Neural Network
원문 초록
This paper presents Generative Adversarial Talking Head (GATH), a novel deep generative neural network that enables fully automatic facial expression synthesis of an arbitrary portrait with continuous action unit (AU) coefficients. Specifically, our model directly manipulates image pixels to make the unseen subject in the still photo express various emotions controlled by values of facial AU coefficients, while maintaining her personal characteristics, such as facial geometry, skin color and hair style, as well as the original surrounding background. In contrast to prior work, GATH is purely data-driven and it requires neither a statistical face model nor image processing tricks to enact facial deformations. Additionally, our model is trained from unpaired data, where the input image, with its auxiliary identity label taken from abundance of still photos in the wild, and the target frame are from different persons. In order to effectively learn such model, we propose a novel weakly supervised adversarial learning framework that consists of a generator, a discriminator, a classifier and an action unit estimator. Our work gives rise to template-and-target-free expression editing, where still faces can be effortlessly animated with arbitrary AU coefficients provided by the user.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors
LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example
ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representations
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
A survey and classification of face alignment methods based on face models
Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.