Softmax Dissection: Towards Understanding Intra- and Inter-class Objective for Embedding Learning
원문 초록
The softmax loss and its variants are widely used as objectives for embedding learning, especially in applications like face recognition. However, the intra- and inter-class objectives in the softmax loss are entangled, therefore a well-optimized inter-class objective leads to relaxation on the intra-class objective, and vice versa. In this paper, we propose to dissect the softmax loss into independent intra- and inter-class objective (D-Softmax). With D-Softmax as objective, we can have a clear understanding of both the intra- and inter-class objective, therefore it is straightforward to tune each part to the best state. Furthermore, we find the computation of the inter-class objective is redundant and propose two sampling-based variants of D-Softmax to reduce the computation cost. Training with regular-scale data, experiments in face verification show D-Softmax is favorably comparable to existing losses such as SphereFace and ArcFace. Training with massive-scale data, experiments show the fast variants of D-Softmax significantly accelerates the training process (such as 64x) with only a minor sacrifice in performance, outperforming existing acceleration methods of softmax in terms of both performance and efficiency.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Rapid Test for Accuracy and Bias of Face Recognition Technology
Sample Correlation for Fingerprinting Deep Face Recognition
Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verification
Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors
50 Years of Automated Face Recognition
Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.