Multi-Domain Norm-referenced Encoding Enables Data Efficient Transfer Learning of Facial Expression Recognition
원문 초록
People can innately recognize human facial expressions in unnatural forms, such as when depicted on the unusual faces drawn in cartoons or when applied to an animal's features. However, current machine learning algorithms struggle with out-of-domain transfer in facial expression recognition (FER). We propose a biologically-inspired mechanism for such transfer learning, which is based on norm-referenced encoding, where patterns are encoded in terms of difference vectors relative to a domain-specific reference vector. By incorporating domain-specific reference frames, we demonstrate high data efficiency in transfer learning across multiple domains. Our proposed architecture provides an explanation for how the human brain might innately recognize facial expressions on varying head shapes (humans, monkeys, and cartoon avatars) without extensive training. Norm-referenced encoding also allows the intensity of the expression to be read out directly from neural unit activity, similar to face-selective neurons in the brain. Our model achieves a classification accuracy of 92.15\% on the FERG dataset with extreme data efficiency. We train our proposed mechanism with only 12 images, including a single image of each class (facial expression) and one image per domain (avatar). In comparison, the authors of the FERG dataset achieved a classification accuracy of 89.02\% with their FaceExpr model, which was trained on 43,000 images.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
EfficientFER: EfficientNetv2 Based Deep Learning Approach for Facial Expression Recognition
Multimodal Prompt Alignment for Facial Expression Recognition
TKFNet: Learning Texture Key Factor Driven Feature for Facial Expression Recognition
Achieving 3D Attention via Triplet Squeeze and Excitation Block
SDAFE: A Dual-filter Stable Diffusion Data Augmentation Method for Facial Expression Recognition
Joint Training on Multiple Datasets With Inconsistent Labeling Criteria for Facial Expression Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.