Full-Body Awareness from Partial Observations
원문 초록
There has been great progress in human 3D mesh recovery and great interest in learning about the world from consumer video data. Unfortunately current methods for 3D human mesh recovery work rather poorly on consumer video data, since on the Internet, unusual camera viewpoints and aggressive truncations are the norm rather than a rarity. We study this problem and make a number of contributions to address it: (i) we propose a simple but highly effective self-training framework that adapts human 3D mesh recovery systems to consumer videos and demonstrate its application to two recent systems; (ii) we introduce evaluation protocols and keypoint annotations for 13K frames across four consumer video datasets for studying this task, including evaluations on out-of-image keypoints; and (iii) we show that our method substantially improves PCK and human-subject judgments compared to baselines, both on test videos from the dataset it was trained on, as well as on three other datasets without further adaptation. Project website: https://crockwell.github.io/partial_humans
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization
Optimizing Local-Global Dependencies for Accurate 3D Human Pose Estimation
Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recovery
ARTS: Semi-Analytical Regressor using Disentangled Skeletal Representations for Human Mesh Recovery from Videos
TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation
DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery
토론
이 논문과 연결된 포럼 글이 아직 없습니다.