CrossHuman: Learning Cross-Guidance from Multi-Frame Images for Human Reconstruction
원문 초록
We propose CrossHuman, a novel method that learns cross-guidance from parametric human model and multi-frame RGB images to achieve high-quality 3D human reconstruction. To recover geometry details and texture even in invisible regions, we design a reconstruction pipeline combined with tracking-based methods and tracking-free methods. Given a monocular RGB sequence, we track the parametric human model in the whole sequence, the points (voxels) corresponding to the target frame are warped to reference frames by the parametric body motion. Guided by the geometry priors of the parametric body and spatially aligned features from RGB sequence, the robust implicit surface is fused. Moreover, a multi-frame transformer (MFT) and a self-supervised warp refinement module are integrated to the framework to relax the requirements of parametric body and help to deal with very loose cloth. Compared with previous works, our CrossHuman enables high-fidelity geometry details and texture in both visible and invisible regions and improves the accuracy of the human reconstruction even under estimated inaccurate parametric human models. The experiments demonstrate that our method achieves state-of-the-art (SOTA) performance.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
LHM: Large Animatable Human Reconstruction Model from a Single Image in Seconds
HumanGif: Single-View Human Diffusion with Generative Prior
Efficient Neural Implicit Representation for 3D Human Reconstruction
Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images
Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformer
Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shot
토론
이 논문과 연결된 포럼 글이 아직 없습니다.