MATCHA:Towards Matching Anything
원문 초록
Establishing correspondences across images is a fundamental challenge in computer vision, underpinning tasks like Structure-from-Motion, image editing, and point tracking. Traditional methods are often specialized for specific correspondence types, geometric, semantic, or temporal, whereas humans naturally identify alignments across these domains. Inspired by this flexibility, we propose MATCHA, a unified feature model designed to ``rule them all'', establishing robust correspondences across diverse matching tasks. Building on insights that diffusion model features can encode multiple correspondence types, MATCHA augments this capacity by dynamically fusing high-level semantic and low-level geometric features through an attention-based module, creating expressive, versatile, and robust features. Additionally, MATCHA integrates object-level features from DINOv2 to further boost generalization, enabling a single feature capable of matching anything. Extensive experiments validate that MATCHA consistently surpasses state-of-the-art methods across geometric, semantic, and temporal matching tasks, setting a new foundation for a unified approach for the fundamental correspondence problem in computer vision. To the best of our knowledge, MATCHA is the first approach that is able to effectively tackle diverse matching tasks with a single unified feature.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SpatialTrackerV2: 3D Point Tracking Made Easy
CharaConsist: Fine-Grained Consistent Character Generation
DragLoRA: Online Optimization of LoRA Adapters for Drag-based Image Editing in Diffusion Model
Seurat: From Moving Points to Depth
TAPIP3D: Tracking Any Point in Persistent 3D Geometry
POMATO: Marrying Pointmap Matching with Temporal Motion for Dynamic 3D Reconstruction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.