Enhancing 2D Representation Learning with a 3D Prior
원문 초록
Learning robust and effective representations of visual data is a fundamental task in computer vision. Traditionally, this is achieved by training models with labeled data which can be expensive to obtain. Self-supervised learning attempts to circumvent the requirement for labeled data by learning representations from raw unlabeled visual data alone. However, unlike humans who obtain rich 3D information from their binocular vision and through motion, the majority of current self-supervised methods are tasked with learning from monocular 2D image collections. This is noteworthy as it has been demonstrated that shape-centric visual processing is more robust compared to texture-biased automated methods. Inspired by this, we propose a new approach for strengthening existing self-supervised methods by explicitly enforcing a strong 3D structural prior directly into the model during training. Through experiments, across a range of datasets, we demonstrate that our 3D aware representations are more robust compared to conventional self-supervised baselines.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Self-supervised Learning of Echocardiographic Video Representations via Online Cluster Distillation
Subgraph Gaussian Embedding Contrast for Self-Supervised Graph Representation Learning
Advancing Video Self-Supervised Learning via Image Foundation Models
ShapeEmbed: a self-supervised learning framework for 2D contour quantification
USAD: Universal Speech and Audio Representation via Distillation
Exploring Non-contrastive Self-supervised Representation Learning for Image-based Profiling
토론
이 논문과 연결된 포럼 글이 아직 없습니다.