V-Hands: Touchscreen-based Hand Tracking for Remote Whiteboard Interaction
원문 초록
In whiteboard-based remote communication, the seamless integration of drawn content and hand-screen interactions is essential for an immersive user experience. Previous methods either require bulky device setups for capturing hand gestures or fail to accurately track the hand poses from capacitive images. In this paper, we present a real-time method for precise tracking 3D poses of both hands from capacitive video frames. To this end, we develop a deep neural network to identify hands and infer hand joint positions from capacitive frames, and then recover 3D hand poses from the hand-joint positions via a constrained inverse kinematic solver. Additionally, we design a device setup for capturing high-quality hand-screen interaction data and obtained a more accurate synchronized capacitive video and hand pose dataset. Our method improves the accuracy and stability of 3D hand tracking for capacitive frames while maintaining a compact device setup for remote communication. We validate our scheme design and its superior performance on 3D hand pose tracking and demonstrate the effectiveness of our method in whiteboard-based remote communication. Our code, model, and dataset are available at https://V-Hands.github.io.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking
SpikeVideoFormer: An Efficient Spike-Driven Video Transformer with Hamming Attention and $\mathcal{O}(T)$ Complexity
Embracing Dynamics: Dynamics-aware 4D Gaussian Splatting SLAM
Stereo Event-based, 6-DOF Pose Tracking for Uncooperative Spacecraft
Segment Anything in Light Fields for Real-Time Applications via Constrained Prompting
ESVO2: Direct Visual-Inertial Odometry with Stereo Event Cameras
토론
이 논문과 연결된 포럼 글이 아직 없습니다.