MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints
원문 초록
This work proposes a novel learning framework for visual hand dynamics analysis that takes into account the physiological aspects of hand motion. The existing models, which are simplified joint-actuated systems, often produce unnatural motions. To address this, we integrate a musculoskeletal system with a learnable parametric hand model, MANO, to create a new model, MS-MANO. This model emulates the dynamics of muscles and tendons to drive the skeletal system, imposing physiologically realistic constraints on the resulting torque trajectories. We further propose a simulation-in-the-loop pose refinement framework, BioPR, that refines the initial estimated pose through a multi-layer perceptron (MLP) network. Our evaluation of the accuracy of MS-MANO and the efficacy of the BioPR is conducted in two separate parts. The accuracy of MS-MANO is compared with MyoSuite, while the efficacy of BioPR is benchmarked against two large-scale public datasets and two recent state-of-the-art methods. The results demonstrate that our approach consistently improves the baseline methods both quantitatively and qualitatively.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking
SpikeVideoFormer: An Efficient Spike-Driven Video Transformer with Hamming Attention and $\mathcal{O}(T)$ Complexity
Embracing Dynamics: Dynamics-aware 4D Gaussian Splatting SLAM
Stereo Event-based, 6-DOF Pose Tracking for Uncooperative Spacecraft
Segment Anything in Light Fields for Real-Time Applications via Constrained Prompting
ESVO2: Direct Visual-Inertial Odometry with Stereo Event Cameras
토론
이 논문과 연결된 포럼 글이 아직 없습니다.