Estimating more camera poses for ego-centric videos is essential for VQ3D
원문 초록
Visual queries 3D localization (VQ3D) is a task in the Ego4D Episodic Memory Benchmark. Given an egocentric video, the goal is to answer queries of the form "Where did I last see object X?", where the query object X is specified as a static image, and the answer should be a 3D displacement vector pointing to object X. However, current techniques use naive ways to estimate the camera poses of video frames, resulting in a low query with pose (QwP) ratio, thus a poor overall success rate. We design a new pipeline for the challenging egocentric video camera pose estimation problem in our work. Moreover, we revisit the current VQ3D framework and optimize it in terms of performance and efficiency. As a result, we get the top-1 overall success rate of 25.8% on VQ3D leaderboard, which is two times better than the 8.7% reported by the baseline.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SpatialTrackerV2: 3D Point Tracking Made Easy
Consensus-Driven Uncertainty for Robotic Grasping based on RGB Perception
RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking
Recollection from Pensieve: Novel View Synthesis via Learning from Uncalibrated Videos
$π^3$: Scalable Permutation-Equivariant Visual Geometry Learning
SGLoc: Semantic Localization System for Camera Pose Estimation from 3D Gaussian Splatting Representation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.