Comprehensive Survey on Counterfactual Explanations
2024
·
Survey
The XAI project publishes in Data Mining and Knowledge Discovery an important survey (Guidotti, 2022) on counterfactual explanations for black box models.
The article provides a comprehensive categorization of counterfactual explainers based on the adopted approach, labeling them according to method characteristics and properties of the returned counterfactuals.
The survey includes a visual comparison of explanations and quantitative benchmarking that evaluates minimality, actionability, stability, diversity, discriminative power, and runtime. The results highlight that the current state of the art does not provide a counterfactual explainer capable of simultaneously guaranteeing all these properties.
References
2022
Counterfactual explanations and how to find them: literature review and benchmarking
Interpretable machine learning aims at unveiling the reasons behind predictions returned by uninterpretable classifiers. One of the most valuable types of explanation consists of counterfactuals. A counterfactual explanation reveals what should have been different in an instance to observe a diverse outcome. For instance, a bank customer asks for a loan that is rejected. The counterfactual explanation consists of what should have been different for the customer in order to have the loan accepted. Recently, there has been an explosion of proposals for counterfactual explainers. The aim of this work is to survey the most recent explainers returning counterfactual explanations. We categorize explainers based on the approach adopted to return the counterfactuals, and we label them according to characteristics of the method and properties of the counterfactuals returned. In addition, we visually compare the explanations, and we report quantitative benchmarking assessing minimality, actionability, stability, diversity, discriminative power, and running time. The results make evident that the current state of the art does not provide a counterfactual explainer able to guarantee all these properties simultaneously.
@article{G2022,address={Netherlands},author={Guidotti, Riccardo},doi={10.1007/s10618-022-00831-6},issn={1573-756X},journal={Data Mining and Knowledge Discovery},line={1},month=apr,number={5},open_access={Gold},pages={2770–2824},publisher={Springer Science and Business Media LLC},title={Counterfactual explanations and how to find them: literature review and benchmarking},visible_on_website={YES},volume={38},year={2022}}