PixHt-Lab: Pixel Height Based Light Effect Generation for Image Compositing
원문 초록
Lighting effects such as shadows or reflections are key in making synthetic images realistic and visually appealing. To generate such effects, traditional computer graphics uses a physically-based renderer along with 3D geometry. To compensate for the lack of geometry in 2D Image compositing, recent deep learning-based approaches introduced a pixel height representation to generate soft shadows and reflections. However, the lack of geometry limits the quality of the generated soft shadows and constrain reflections to pure specular ones. We introduce PixHt-Lab, a system leveraging an explicit mapping from pixel height representation to 3D space. Using this mapping, PixHt-Lab reconstructs both the cutout and background geometry and renders realistic, diverse, lighting effects for image compositing. Given a surface with physically-based materials, we can render reflections with varying glossiness. To generate more realistic soft shadows, we further propose to use 3D-aware buffer channels to guide a neural renderer. Both quantitative and qualitative evaluations demonstrate that PixHt-Lab significantly improves soft shadow generation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SparseGS: Sparse View Synthesis using 3D Gaussian Splatting
Feed-Forward SceneDINO for Unsupervised Semantic Scene Completion
Dense 3D Displacement Estimation for Landslide Monitoring via Fusion of TLS Point Clouds and Embedded RGB Images
ScaleLSD: Scalable Deep Line Segment Detection Streamlined
GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Control
Recollection from Pensieve: Novel View Synthesis via Learning from Uncalibrated Videos
토론
이 논문과 연결된 포럼 글이 아직 없습니다.