GANESH: Generalizable NeRF for Lensless Imaging
원문 초록
Lensless imaging offers a significant opportunity to develop ultra-compact cameras by removing the conventional bulky lens system. However, without a focusing element, the sensor's output is no longer a direct image but a complex multiplexed scene representation. Traditional methods have attempted to address this challenge by employing learnable inversions and refinement models, but these methods are primarily designed for 2D reconstruction and do not generalize well to 3D reconstruction. We introduce GANESH, a novel framework designed to enable simultaneous refinement and novel view synthesis from multi-view lensless images. Unlike existing methods that require scene-specific training, our approach supports on-the-fly inference without retraining on each scene. Moreover, our framework allows us to tune our model to specific scenes, enhancing the rendering and refinement quality. To facilitate research in this area, we also present the first multi-view lensless dataset, LenslessScenes. Extensive experiments demonstrate that our method outperforms current approaches in reconstruction accuracy and refinement quality. Code and video results are available at https://rakesh-123-cryp.github.io/Rakesh.github.io/
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
R3eVision: A Survey on Robust Rendering, Restoration, and Enhancement for 3D Low-Level Vision
SPC to 3D: Novel View Synthesis from Binary SPC via I2I translation
Splat and Replace: 3D Reconstruction with Repetitive Elements
ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimation
ErpGS: Equirectangular Image Rendering enhanced with 3D Gaussian Regularization
Geometric Prior-Guided Neural Implicit Surface Reconstruction in the Wild
토론
이 논문과 연결된 포럼 글이 아직 없습니다.