Recovering Facial Reflectance and Geometry from Multi-view Images
원문 초록
While the problem of estimating shapes and diffuse reflectances of human faces from images has been extensively studied, there is relatively less work done on recovering the specular albedo. This paper presents a lightweight solution for inferring photorealistic facial reflectance and geometry. Our system processes video streams from two views of a subject, and outputs two reflectance maps for diffuse and specular albedos, as well as a vector map of surface normals. A model-based optimization approach is used, consisting of the three stages of multi-view face model fitting, facial reflectance inference and facial geometry refinement. Our approach is based on a novel formulation built upon the 3D morphable model (3DMM) for representing 3D textured faces in conjunction with the Blinn-Phong reflection model. It has the advantage of requiring only a simple setup with two video streams, and is able to exploit the interaction between the diffuse and specular reflections across multiple views as well as time frames. As a result, the method is able to reliably recover high-fidelity facial reflectance and geometry, which facilitates various applications such as generating photorealistic facial images under new viewpoints or illumination conditions.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors
LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example
ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representations
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
A survey and classification of face alignment methods based on face models
Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.