CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Rendering
원문 초록
Intrinsic image decomposition is a challenging, long-standing computer vision problem for which ground truth data is very difficult to acquire. We explore the use of synthetic data for training CNN-based intrinsic image decomposition models, then applying these learned models to real-world images. To that end, we present \ICG, a new, large-scale dataset of physically-based rendered images of scenes with full ground truth decompositions. The rendering process we use is carefully designed to yield high-quality, realistic images, which we find to be crucial for this problem domain. We also propose a new end-to-end training method that learns better decompositions by leveraging \ICG, and optionally IIW and SAW, two recent datasets of sparse annotations on real-world images. Surprisingly, we find that a decomposition network trained solely on our synthetic data outperforms the state-of-the-art on both IIW and SAW, and performance improves even further when IIW and SAW data is added during training. Our work demonstrates the suprising effectiveness of carefully-rendered synthetic data for the intrinsic images task.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
EndoMUST: Monocular Depth Estimation for Robotic Endoscopy via End-to-end Multi-step Self-supervised Training
MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fields
Colorful Diffuse Intrinsic Image Decomposition in the Wild
A General Albedo Recovery Approach for Aerial Photogrammetric Images through Inverse Rendering
Exploiting Diffusion Prior for Generalizable Dense Prediction
HyperDID: Hyperspectral Intrinsic Image Decomposition with Deep Feature Embedding
토론
이 논문과 연결된 포럼 글이 아직 없습니다.