Self-supervised Contrastive Learning of Multi-view Facial Expressions
원문 초록
Facial expression recognition (FER) has emerged as an important component of human-computer interaction systems. Despite recent advancements in FER, performance often drops significantly for non-frontal facial images. We propose Contrastive Learning of Multi-view facial Expressions (CL-MEx) to exploit facial images captured simultaneously from different angles towards FER. CL-MEx is a two-step training framework. In the first step, an encoder network is pre-trained with the proposed self-supervised contrastive loss, where it learns to generate view-invariant embeddings for different views of a subject. The model is then fine-tuned with labeled data in a supervised setting. We demonstrate the performance of the proposed method on two multi-view FER datasets, KDEF and DDCF, where state-of-the-art performances are achieved. Further experiments show the robustness of our method in dealing with challenging angles and reduced amounts of labeled data.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Multimodal Prompt Alignment for Facial Expression Recognition
EfficientFER: EfficientNetv2 Based Deep Learning Approach for Facial Expression Recognition
TKFNet: Learning Texture Key Factor Driven Feature for Facial Expression Recognition
Unsupervised Multiview Contrastive Language-Image Joint Learning with Pseudo-Labeled Prompts Via Vision-Language Model for 3D/4D Facial Expression Recognition
Achieving 3D Attention via Triplet Squeeze and Excitation Block
SDAFE: A Dual-filter Stable Diffusion Data Augmentation Method for Facial Expression Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.