Modality Unifying Network for Visible-Infrared Person Re-Identification
원문 초록
Visible-infrared person re-identification (VI-ReID) is a challenging task due to large cross-modality discrepancies and intra-class variations. Existing methods mainly focus on learning modality-shared representations by embedding different modalities into the same feature space. As a result, the learned feature emphasizes the common patterns across modalities while suppressing modality-specific and identity-aware information that is valuable for Re-ID. To address these issues, we propose a novel Modality Unifying Network (MUN) to explore a robust auxiliary modality for VI-ReID. First, the auxiliary modality is generated by combining the proposed cross-modality learner and intra-modality learner, which can dynamically model the modality-specific and modality-shared representations to alleviate both cross-modality and intra-modality variations. Second, by aligning identity centres across the three modalities, an identity alignment loss function is proposed to discover the discriminative feature representations. Third, a modality alignment loss is introduced to consistently reduce the distribution distance of visible and infrared images by modality prototype modeling. Extensive experiments on multiple public datasets demonstrate that the proposed method surpasses the current state-of-the-art methods by a significant margin.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Try Harder: Hard Sample Generation and Learning for Clothes-Changing Person Re-ID
Following the Clues: Experiments on Person Re-ID using Cross-Modal Intelligence
Domain Generalization for Person Re-identification: A Survey Towards Domain-Agnostic Person Matching
ReID5o: Achieving Omni Multi-modal Person Re-identification in a Single Model
S3CE-Net: Spike-guided Spatiotemporal Semantic Coupling and Expansion Network for Long Sequence Event Re-Identification
Differentiable Channel Selection in Self-Attention For Person Re-Identification
토론
이 논문과 연결된 포럼 글이 아직 없습니다.