Dynamic Enhancement Network for Partial Multi-modality Person Re-identification
원문 초록
Many existing multi-modality studies are based on the assumption of modality integrity. However, the problem of missing arbitrary modalities is very common in real life, and this problem is less studied, but actually important in the task of multi-modality person re-identification (Re-ID). To this end, we design a novel dynamic enhancement network (DENet), which allows missing arbitrary modalities while maintaining the representation ability of multiple modalities, for partial multi-modality person Re-ID. To be specific, the multi-modal representation of the RGB, near-infrared (NIR) and thermal-infrared (TIR) images is learned by three branches, in which the information of missing modalities is recovered by the feature transformation module. Since the missing state might be changeable, we design a dynamic enhancement module, which dynamically enhances modality features according to the missing state in an adaptive manner, to improve the multi-modality representation. Extensive experiments on multi-modality person Re-ID dataset RGBNT201 and vehicle Re-ID dataset RGBNT100 comparing to the state-of-the-art methods verify the effectiveness of our method in complex and changeable environments.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Try Harder: Hard Sample Generation and Learning for Clothes-Changing Person Re-ID
Following the Clues: Experiments on Person Re-ID using Cross-Modal Intelligence
Domain Generalization for Person Re-identification: A Survey Towards Domain-Agnostic Person Matching
ReID5o: Achieving Omni Multi-modal Person Re-identification in a Single Model
S3CE-Net: Spike-guided Spatiotemporal Semantic Coupling and Expansion Network for Long Sequence Event Re-Identification
Differentiable Channel Selection in Self-Attention For Person Re-Identification
토론
이 논문과 연결된 포럼 글이 아직 없습니다.