Can Explainable AI Explain Unfairness? A Framework for Evaluating Explainable AI
원문 초록
Many ML models are opaque to humans, producing decisions too complex for humans to easily understand. In response, explainable artificial intelligence (XAI) tools that analyze the inner workings of a model have been created. Despite these tools' strength in translating model behavior, critiques have raised concerns about the impact of XAI tools as a tool for `fairwashing` by misleading users into trusting biased or incorrect models. In this paper, we created a framework for evaluating explainable AI tools with respect to their capabilities for detecting and addressing issues of bias and fairness as well as their capacity to communicate these results to their users clearly. We found that despite their capabilities in simplifying and explaining model behavior, many prominent XAI tools lack features that could be critical in detecting bias. Developers can use our framework to suggest modifications needed in their toolkits to reduce issues likes fairwashing.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Communicating Smartly in the Molecular Domain: Neural Networks in the Internet of Bio-Nano Things
midr: Learning from Black-Box Models by Maximum Interpretation Decomposition
Do Protein Transformers Have Biological Intelligence?
TIMING: Temporality-Aware Integrated Gradients for Time Series Explanation
Addressing the Scarcity of Benchmarks for Graph XAI
Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitors
토론
이 논문과 연결된 포럼 글이 아직 없습니다.