Siamese Infrared and Visible Light Fusion Network for RGB-T Tracking
원문 초록
Due to the different photosensitive properties of infrared and visible light, the registered RGB-T image pairs shot in the same scene exhibit quite different characteristics. This paper proposes a siamese infrared and visible light fusion Network (SiamIVFN) for RBG-T image-based tracking. SiamIVFN contains two main subnetworks: a complementary-feature-fusion network (CFFN) and a contribution-aggregation network (CAN). CFFN utilizes a two-stream multilayer convolutional structure whose filters for each layer are partially coupled to fuse the features extracted from infrared images and visible light images. CFFN is a feature-level fusion network, which can cope with the misalignment of the RGB-T image pairs. Through adaptively calculating the contributions of infrared and visible light features obtained from CFFN, CAN makes the tracker robust under various light conditions. Experiments on two RGB-T tracking benchmark datasets demonstrate that the proposed SiamIVFN has achieved state-of-the-art performance. The tracking speed of SiamIVFN is 147.6FPS, the current fastest RGB-T fusion tracker.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Modality-Guided Dynamic Graph Fusion and Temporal Diffusion for Self-Supervised RGB-T Tracking
SUTrack: Towards Simple and Unified Single Object Tracking
Exploiting Multimodal Spatial-temporal Patterns for Video Object Tracking
Breaking Modality Gap in RGBT Tracking: Coupled Knowledge Distillation
Transformer-based RGB-T Tracking with Channel and Spatial Feature Fusion
AFter: Attention-based Fusion Router for RGBT Tracking
토론
이 논문과 연결된 포럼 글이 아직 없습니다.