An Experimental Study of Quantitative Evaluations on Saliency Methods
원문 초록
It has been long debated that eXplainable AI (XAI) is an important technology for model and data exploration, validation, and debugging. To deploy XAI into actual systems, an executable and comprehensive evaluation of the quality of generated explanation is highly in demand. In this paper, we briefly summarize the status quo of the quantitative metrics of different properties of XAI including evaluation on faithfulness, localization, sensitivity check, and stability. With an exhaustive experimental study based on them, we conclude that among all the typical methods we compare, no single explanation method dominates others in all metrics. Nonetheless, Gradient-weighted Class Activation Mapping (Grad-CAM) and Randomly Input Sampling for Explanation (RISE) perform fairly well in most of the metrics. We further present a novel utilization of the evaluation results to diagnose the classification bases for models. Hopefully, this valuable work could serve as a guide for future research.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Evaluating the Robustness of Adversarial Defenses in Malware Detection Systems
MADCAT: Combating Malware Detection Under Concept Drift with Test-Time Adaptation
OpCode-Based Malware Classification Using Machine Learning and Deep Learning Techniques
BERTDetect: A Neural Topic Modelling Approach for Android Malware Detection
Trust Under Siege: Label Spoofing Attacks against Machine Learning for Android Malware Detection
LAMD: Context-driven Android Malware Detection and Classification with LLMs
토론
이 논문과 연결된 포럼 글이 아직 없습니다.