Automatic Analysis of Facial Expressions Based on Deep Covariance Trajectories
원문 초록
In this paper, we propose a new approach for facial expression recognition using deep covariance descriptors. The solution is based on the idea of encoding local and global Deep Convolutional Neural Network (DCNN) features extracted from still images, in compact local and global covariance descriptors. The space geometry of the covariance matrices is that of Symmetric Positive Definite (SPD) matrices. By conducting the classification of static facial expressions using Support Vector Machine (SVM) with a valid Gaussian kernel on the SPD manifold, we show that deep covariance descriptors are more effective than the standard classification with fully connected layers and softmax. Besides, we propose a completely new and original solution to model the temporal dynamic of facial expressions as deep trajectories on the SPD manifold. As an extension of the classification pipeline of covariance descriptors, we apply SVM with valid positive definite kernels derived from global alignment for deep covariance trajectories classification. By performing extensive experiments on the Oulu-CASIA, CK+, and SFEW datasets, we show that both the proposed static and dynamic approaches achieve state-of-the-art performance for facial expression recognition outperforming many recent approaches.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Multimodal Prompt Alignment for Facial Expression Recognition
EfficientFER: EfficientNetv2 Based Deep Learning Approach for Facial Expression Recognition
SDAFE: A Dual-filter Stable Diffusion Data Augmentation Method for Facial Expression Recognition
Joint Training on Multiple Datasets With Inconsistent Labeling Criteria for Facial Expression Recognition
FerNeXt: Facial Expression Recognition Using ConvNeXt with Channel Attention
DetFusion: A Detection-driven Infrared and Visible Image Fusion Network
토론
이 논문과 연결된 포럼 글이 아직 없습니다.