A Versatile Scene Model with Differentiable Visibility Applied to Generative Pose Estimation
원문 초록
Generative reconstruction methods compute the 3D configuration (such as pose and/or geometry) of a shape by optimizing the overlap of the projected 3D shape model with images. Proper handling of occlusions is a big challenge, since the visibility function that indicates if a surface point is seen from a camera can often not be formulated in closed form, and is in general discrete and non-differentiable at occlusion boundaries. We present a new scene representation that enables an analytically differentiable closed-form formulation of surface visibility. In contrast to previous methods, this yields smooth, analytically differentiable, and efficient to optimize pose similarity energies with rigorous occlusion handling, fewer local minima, and experimentally verified improved convergence of numerical optimization. The underlying idea is a new image formation model that represents opaque objects by a translucent medium with a smooth Gaussian density distribution which turns visibility into a smooth phenomenon. We demonstrate the advantages of our versatile scene model in several generative pose estimation problems, namely marker-less multi-object pose estimation, marker-less human motion capture with few cameras, and image-based 3D geometry estimation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Control
Recollection from Pensieve: Novel View Synthesis via Learning from Uncalibrated Videos
LiftFeat: 3D Geometry-Aware Local Feature Matching
ViTaSCOPE: Visuo-tactile Implicit Representation for In-hand Pose and Extrinsic Contact Estimation
Self-Supervised Monocular Visual Drone Model Identification through Improved Occlusion Handling
DeepSTEP: Simultaneous Tracking and Estimation of Pose for Animals and Humans
토론
이 논문과 연결된 포럼 글이 아직 없습니다.