Explanation-based Counterfactual Retraining(XCR): A Calibration Method for Black-box Models
원문 초록
With the rapid development of eXplainable Artificial Intelligence (XAI), a long line of past work has shown concerns about the Out-of-Distribution (OOD) problem in perturbation-based post-hoc XAI models and explanations are socially misaligned. We explore the limitations of post-hoc explanation methods that use approximators to mimic the behavior of black-box models. Then we propose eXplanation-based Counterfactual Retraining (XCR), which extracts feature importance fastly. XCR applies the explanations generated by the XAI model as counterfactual input to retrain the black-box model to address OOD and social misalignment problems. Evaluation of popular image datasets shows that XCR can improve model performance when only retaining 12.5% of the most crucial features without changing the black-box model structure. Furthermore, the evaluation of the benchmark of corruption datasets shows that the XCR is very helpful for improving model robustness and positively impacts the calibration of OOD problems. Even though not calibrated in the validation set like some OOD calibration methods, the corrupted data metric outperforms existing methods. Our method also beats current OOD calibration methods on the OOD calibration metric if calibration on the validation set is applied.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
DiCoFlex: Model-agnostic diverse counterfactuals with flexible control
From What Ifs to Insights: Counterfactuals in Causal Inference vs. Explainable AI
Financial Fraud Detection Using Explainable AI and Stacking Ensemble Methods
Explainable Artificial Intelligence Techniques for Software Development Lifecycle: A Phase-specific Survey
Machine Learning Meets Transparency in Osteoporosis Risk Assessment: A Comparative Study of ML and Explainability Analysis
DiCE-Extended: A Robust Approach to Counterfactual Explanations in Machine Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.