DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Cameras
원문 초록
We propose DiffuStereo, a novel system using only sparse cameras (8 in this work) for high-quality 3D human reconstruction. At its core is a novel diffusion-based stereo module, which introduces diffusion models, a type of powerful generative models, into the iterative stereo matching network. To this end, we design a new diffusion kernel and additional stereo constraints to facilitate stereo matching and depth estimation in the network. We further present a multi-level stereo network architecture to handle high-resolution (up to 4k) inputs without requiring unaffordable memory footprint. Given a set of sparse-view color images of a human, the proposed multi-level diffusion-based stereo network can produce highly accurate depth maps, which are then converted into a high-quality 3D human model through an efficient multi-view fusion strategy. Overall, our method enables automatic reconstruction of human models with quality on par to high-end dense-view camera rigs, and this is achieved using a much more light-weight hardware setup. Experiments show that our method outperforms state-of-the-art methods by a large margin both qualitatively and quantitatively.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Multi-Label Stereo Matching for Transparent Scene Depth Estimation
Boosting Omnidirectional Stereo Matching with a Pre-trained Depth Foundation Model
FoundationStereo: Zero-Shot Stereo Matching
DEFOM-Stereo: Depth Foundation Model Based Stereo Matching
MonSter: Marry Monodepth to Stereo Unleashes Power
$S^2M^2$: Scalable Stereo Matching Model for Reliable Depth Estimation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.