Label quality in AffectNet: results of crowd-based re-annotation
원문 초록
AffectNet is one of the most popular resources for facial expression recognition (FER) on relatively unconstrained in-the-wild images. Given that images were annotated by only one annotator with limited consistency checks on the data, however, label quality and consistency may be limited. Here, we take a similar approach to a study that re-labeled another, smaller dataset (FER2013) with crowd-based annotations, and report results from a re-labeling and re-annotation of a subset of difficult AffectNet faces with 13 people on both expression label, and valence and arousal ratings. Our results show that human labels overall have medium to good consistency, whereas human ratings especially for valence are in excellent agreement. Importantly, however, crowd-based labels are significantly shifting towards neutral and happy categories and crowd-based affective ratings form a consistent pattern different from the original ratings. ResNets fully trained on the original AffectNet dataset do not predict human voting patterns, but when weakly-trained do so much better, particularly for valence. Our results have important ramifications for label quality in affective computing.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Disentangled Source-Free Personalization for Facial Expression Recognition with Neutral Target Data
V-NAW: Video-based Noise-aware Adaptive Weighting for Facial Expression Recognition
Biased Heritage: How Datasets Shape Models in Facial Expression Recognition
Navigating Label Ambiguity for Facial Expression Recognition in the Wild
Unimodal and Multimodal Static Facial Expression Recognition for Virtual Reality Users with EmoHeVRDB
QCS: Feature Refining from Quadruplet Cross Similarity for Facial Expression Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.