Learned reconstructions for practical mask-based lensless imaging
원문 초록
Mask-based lensless imagers are smaller and lighter than traditional lensed cameras. In these imagers, the sensor does not directly record an image of the scene; rather, a computational algorithm reconstructs it. Typically, mask-based lensless imagers use a model-based reconstruction approach that suffers from long compute times and a heavy reliance on both system calibration and heuristically chosen denoisers. In this work, we address these limitations using a bounded-compute, trainable neural network to reconstruct the image. We leverage our knowledge of the physical system by unrolling a traditional model-based optimization algorithm, whose parameters we optimize using experimentally gathered ground-truth data. Optionally, images produced by the unrolled network are then fed into a jointly-trained denoiser. As compared to traditional methods, our architecture achieves better perceptual image quality and runs 20x faster, enabling interactive previewing of the scene. We explore a spectrum between model-based and deep learning methods, showing the benefits of using an intermediate approach. Finally, we test our network on images taken in the wild with a prototype mask-based camera, demonstrating that our network generalizes to natural images.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SelfDRSC++: Self-Supervised Dual Reversed Rolling Shutter Correction via Video Interpolation
Rolling Shutter Correction with Intermediate Distortion Flow Estimation
UniINR: Event-guided Unified Rolling Shutter Correction, Deblurring, and Interpolation
Stochastic Unrolled Federated Learning
Neural Image Re-Exposure
A Compound Gaussian Least Squares Algorithm and Unrolled Network for Linear Inverse Problems
토론
이 논문과 연결된 포럼 글이 아직 없습니다.