Learning to Factorize and Relight a City
원문 초록
We propose a learning-based framework for disentangling outdoor scenes into temporally-varying illumination and permanent scene factors. Inspired by the classic intrinsic image decomposition, our learning signal builds upon two insights: 1) combining the disentangled factors should reconstruct the original image, and 2) the permanent factors should stay constant across multiple temporal samples of the same scene. To facilitate training, we assemble a city-scale dataset of outdoor timelapse imagery from Google Street View, where the same locations are captured repeatedly through time. This data represents an unprecedented scale of spatio-temporal outdoor imagery. We show that our learned disentangled factors can be used to manipulate novel images in realistic ways, such as changing lighting effects and scene geometry. Please visit factorize-a-city.github.io for animated results.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
EndoMUST: Monocular Depth Estimation for Robotic Endoscopy via End-to-end Multi-step Self-supervised Training
MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fields
Colorful Diffuse Intrinsic Image Decomposition in the Wild
A General Albedo Recovery Approach for Aerial Photogrammetric Images through Inverse Rendering
Exploiting Diffusion Prior for Generalizable Dense Prediction
HyperDID: Hyperspectral Intrinsic Image Decomposition with Deep Feature Embedding
토론
이 논문과 연결된 포럼 글이 아직 없습니다.