ContactArt: Learning 3D Interaction Priors for Category-level Articulated Object and Hand Poses Estimation
원문 초록
We propose a new dataset and a novel approach to learning hand-object interaction priors for hand and articulated object pose estimation. We first collect a dataset using visual teleoperation, where the human operator can directly play within a physical simulator to manipulate the articulated objects. We record the data and obtain free and accurate annotations on object poses and contact information from the simulator. Our system only requires an iPhone to record human hand motion, which can be easily scaled up and largely lower the costs of data and annotation collection. With this data, we learn 3D interaction priors including a discriminator (in a GAN) capturing the distribution of how object parts are arranged, and a diffusion model which generates the contact regions on articulated objects, guiding the hand pose estimation. Such structural and contact priors can easily transfer to real-world data with barely any domain gap. By using our data and learned priors, our method significantly improves the performance on joint hand and articulated object poses estimation over the existing state-of-the-art methods. The project is available at https://zehaozhu.github.io/ContactArt/ .
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Consensus-Driven Uncertainty for Robotic Grasping based on RGB Perception
RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking
Monocular 3D Hand Pose Estimation with Implicit Camera Alignment
LMPNet for Weakly-supervised Keypoint Discovery
Deterministic Object Pose Confidence Region Estimation
JENGA: Object selection and pose estimation for robotic grasping from a stack
토론
이 논문과 연결된 포럼 글이 아직 없습니다.