Teacher-Student Training and Triplet Loss for Facial Expression Recognition under Occlusion
원문 초록
In this paper, we study the task of facial expression recognition under strong occlusion. We are particularly interested in cases where 50% of the face is occluded, e.g. when the subject wears a Virtual Reality (VR) headset. While previous studies show that pre-training convolutional neural networks (CNNs) on fully-visible (non-occluded) faces improves the accuracy, we propose to employ knowledge distillation to achieve further improvements. First of all, we employ the classic teacher-student training strategy, in which the teacher is a CNN trained on fully-visible faces and the student is a CNN trained on occluded faces. Second of all, we propose a new approach for knowledge distillation based on triplet loss. During training, the goal is to reduce the distance between an anchor embedding, produced by a student CNN that takes occluded faces as input, and a positive embedding (from the same class as the anchor), produced by a teacher CNN trained on fully-visible faces, so that it becomes smaller than the distance between the anchor and a negative embedding (from a different class than the anchor), produced by the student CNN. Third of all, we propose to combine the distilled embeddings obtained through the classic teacher-student strategy and our novel teacher-student strategy based on triplet loss into a single embedding vector. We conduct experiments on two benchmarks, FER+ and AffectNet, with two CNN architectures, VGG-f and VGG-face, showing that knowledge distillation can bring significant improvements over the state-of-the-art methods designed for occluded faces in the VR setting.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
EfficientFER: EfficientNetv2 Based Deep Learning Approach for Facial Expression Recognition
SDAFE: A Dual-filter Stable Diffusion Data Augmentation Method for Facial Expression Recognition
Joint Training on Multiple Datasets With Inconsistent Labeling Criteria for Facial Expression Recognition
FerNeXt: Facial Expression Recognition Using ConvNeXt with Channel Attention
DetFusion: A Detection-driven Infrared and Visible Image Fusion Network
Classifying emotions and engagement in online learning based on a single facial expression recognition neural network
토론
이 논문과 연결된 포럼 글이 아직 없습니다.