DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model
원문 초록
We propose \textbf{DMV3D}, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise noisy multi-view images via NeRF reconstruction and rendering, achieving single-stage 3D generation in $\sim$30s on single A100 GPU. We train \textbf{DMV3D} on large-scale multi-view image datasets of highly diverse objects using only image reconstruction losses, without accessing 3D assets. We demonstrate state-of-the-art results for the single-image reconstruction problem where probabilistic modeling of unseen object parts is required for generating diverse reconstructions with sharp textures. We also show high-quality text-to-3D generation results outperforming previous 3D diffusion models. Our project website is at: https://justimyhxu.github.io/projects/dmv3d/ .
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
LangMamba: A Language-driven Mamba Framework for Low-dose CT Denoising with Vision-language Models
Imaging at the quantum limit with convolutional neural networks
Plug-and-Play Linear Attention for Pre-trained Image and Video Restoration Models
Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models
DreamArt: Generating Interactable Articulated Objects from a Single Image
Color Image Restoration Exploiting Inter-channel Correlation with a 3-stage CNN
토론
이 논문과 연결된 포럼 글이 아직 없습니다.