PIE: Portrait Image Embedding for Semantic Control
원문 초록
Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to computer animation controls. The vast majority of existing techniques do not provide such intuitive and fine-grained control, or only enable coarse editing of a single isolated control parameter. Very recently, high-quality semantically controlled editing has been demonstrated, however only on synthetically created StyleGAN images. We present the first approach for embedding real portrait images in the latent space of StyleGAN, which allows for intuitive editing of the head pose, facial expression, and scene illumination in the image. Semantic editing in parameter space is achieved based on StyleRig, a pretrained neural network that maps the control space of a 3D morphable face model to the latent space of the GAN. We design a novel hierarchical non-linear optimization problem to obtain the embedding. An identity preservation energy term allows spatially coherent edits while maintaining facial integrity. Our approach runs at interactive frame rates and thus allows the user to explore the space of possible edits. We evaluate our approach on a wide set of portrait photos, compare it to the current state of the art, and validate the effectiveness of its components in an ablation study.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors
LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example
ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representations
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
A survey and classification of face alignment methods based on face models
Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.