"Explanation" is Not a Technical Term: The Problem of Ambiguity in XAI
원문 초록
There is broad agreement that Artificial Intelligence (AI) systems, particularly those using Machine Learning (ML), should be able to "explain" their behavior. Unfortunately, there is little agreement as to what constitutes an "explanation." This has caused a disconnect between the explanations that systems produce in service of explainable Artificial Intelligence (XAI) and those explanations that users and other audiences actually need, which should be defined by the full spectrum of functional roles, audiences, and capabilities for explanation. In this paper, we explore the features of explanations and how to use those features in evaluating their utility. We focus on the requirements for explanations defined by their functional role, the knowledge states of users who are trying to understand them, and the availability of the information needed to generate them. Further, we discuss the risk of XAI enabling trust in systems without establishing their trustworthiness and define a critical next step for the field of XAI to establish metrics to guide and ground the utility of system-generated explanations.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Communicating Smartly in the Molecular Domain: Neural Networks in the Internet of Bio-Nano Things
midr: Learning from Black-Box Models by Maximum Interpretation Decomposition
Do Protein Transformers Have Biological Intelligence?
TIMING: Temporality-Aware Integrated Gradients for Time Series Explanation
Addressing the Scarcity of Benchmarks for Graph XAI
Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitors
토론
이 논문과 연결된 포럼 글이 아직 없습니다.