Generalized Bilinear Deep Convolutional Neural Networks for Multimodal Biometric Identification
원문 초록
In this paper, we propose to employ a bank of modality-dedicated Convolutional Neural Networks (CNNs), fuse, train, and optimize them together for person classification tasks. A modality-dedicated CNN is used for each modality to extract modality-specific features. We demonstrate that, rather than spatial fusion at the convolutional layers, the fusion can be performed on the outputs of the fully-connected layers of the modality-specific CNNs without any loss of performance and with significant reduction in the number of parameters. We show that, using multiple CNNs with multimodal fusion at the feature-level, we significantly outperform systems that use unimodal representation. We study weighted feature, bilinear, and compact bilinear feature-level fusion algorithms for multimodal biometric person identification. Finally, We propose generalized compact bilinear fusion algorithm to deploy both the weighted feature fusion and compact bilinear schemes. We provide the results for the proposed algorithms on three challenging databases: CMU Multi-PIE, BioCop, and BIOMDATA.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interaction
KNN-MMD: Cross Domain Wireless Sensing via Local Distribution Alignment
CrossFi: A Cross Domain Wi-Fi Sensing Framework Based on Siamese Network
OpenGait: A Comprehensive Benchmark Study for Gait Recognition towards Better Practicality
Activity-Biometrics: Person Identification from Daily Activities
Finding the Missing Data: A BERT-inspired Approach Against Package Loss in Wireless Sensing
토론
이 논문과 연결된 포럼 글이 아직 없습니다.