InverseFaceNet: Deep Monocular Inverse Face Rendering
원문 초록
We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a single image, advanced editing possibilities on a single face image, such as appearance editing and relighting, become feasible in real time. Most previous learning-based face reconstruction approaches do not jointly recover all dimensions, or are severely limited in terms of visual quality. In contrast, we propose to recover high-quality facial pose, shape, expression, reflectance and illumination using a deep neural network that is trained using a large, synthetically created training corpus. Our approach builds on a novel loss function that measures model-space similarity directly in parameter space and significantly improves reconstruction accuracy. We further propose a self-supervised bootstrapping process in the network training loop, which iteratively updates the synthetic training corpus to better reflect the distribution of real-world imagery. We demonstrate that this strategy outperforms completely synthetically trained networks. Finally, we show high-quality reconstructions and compare our approach to several state-of-the-art approaches.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
MonoNPHM: Dynamic Head Reconstruction from Monocular Videos
GAN2X: Non-Lambertian Inverse Rendering of Image GANs
TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splatting
3D Face Reconstruction Error Decomposed: A Modular Benchmark for Fair and Fast Method Evaluation
SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Rendering
TensoFlow: Tensorial Flow-based Sampler for Inverse Rendering
토론
이 논문과 연결된 포럼 글이 아직 없습니다.