Improving Model's Focus Improves Performance of Deep Learning-Based Synthetic Face Detectors
원문 초록
Deep learning-based models generalize better to unknown data samples after being guided "where to look" by incorporating human perception into training strategies. We made an observation that the entropy of the model's salience trained in that way is lower when compared to salience entropy computed for models training without human perceptual intelligence. Thus the question: does further increase of model's focus, by lowering the entropy of model's class activation map, help in further increasing the performance? In this paper we propose and evaluate several entropy-based new loss function components controlling the model's focus, covering the full range of the level of such control, from none to its "aggressive" minimization. We show, using a problem of synthetic face detection, that improving the model's focus, through lowering entropy, leads to models that perform better in an open-set scenario, in which the test samples are synthesized by unknown generative models. We also show that optimal performance is obtained when the model's loss function blends three aspects: regular classification, low-entropy of the model's focus, and human-guided saliency.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Colors Matter: AI-Driven Exploration of Human Feature Colors
Transforming faces into video stories -- VideoFace2.0
Robust AI-Generated Face Detection with Imbalanced Data
FairDeFace: Evaluating the Fairness and Adversarial Robustness of Face Obfuscation Methods
MTCAE-DFER: Multi-Task Cascaded Autoencoder for Dynamic Facial Expression Recognition
Leveraging Content and Context Cues for Low-Light Image Enhancement
토론
이 논문과 연결된 포럼 글이 아직 없습니다.