NeRF-US: Removing Ultrasound Imaging Artifacts from Neural Radiance Fields in the Wild
원문 초록
Current methods for performing 3D reconstruction and novel view synthesis (NVS) in ultrasound imaging data often face severe artifacts when training NeRF-based approaches. The artifacts produced by current approaches differ from NeRF floaters in general scenes because of the unique nature of ultrasound capture. Furthermore, existing models fail to produce reasonable 3D reconstructions when ultrasound data is captured or obtained casually in uncontrolled environments, which is common in clinical settings. Consequently, existing reconstruction and NVS methods struggle to handle ultrasound motion, fail to capture intricate details, and cannot model transparent and reflective surfaces. In this work, we introduced NeRF-US, which incorporates 3D-geometry guidance for border probability and scattering density into NeRF training, while also utilizing ultrasound-specific rendering over traditional volume rendering. These 3D priors are learned through a diffusion model. Through experiments conducted on our new "Ultrasound in the Wild" dataset, we observed accurate, clinically plausible, artifact-free reconstructions.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Geometric Prior-Guided Neural Implicit Surface Reconstruction in the Wild
R3eVision: A Survey on Robust Rendering, Restoration, and Enhancement for 3D Low-Level Vision
PanSt3R: Multi-view Consistent Panoptic Segmentation
SPC to 3D: Novel View Synthesis from Binary SPC via I2I translation
Splat and Replace: 3D Reconstruction with Repetitive Elements
ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.