TY - CONF T1 - Black Box Explanation by Learning Image Exemplars in the Latent Feature Space T2 - Machine Learning and Knowledge Discovery in Databases Y1 - 2020 A1 - Riccardo Guidotti A1 - Anna Monreale A1 - Matwin, Stan A1 - Dino Pedreschi ED - Brefeld, Ulf ED - Fromont, Elisa ED - Hotho, Andreas ED - Knobbe, Arno ED - Maathuis, Marloes ED - Robardet, Céline AB - We present an approach to explain the decisions of black box models for image classification. While using the black box to label images, our explanation method exploits the latent feature space learned through an adversarial autoencoder. The proposed method first generates exemplar images in the latent feature space and learns a decision tree classifier. Then, it selects and decodes exemplars respecting local decision rules. Finally, it visualizes them in a manner that shows to the user how the exemplars can be modified to either stay within their class, or to become counter-factuals by “morphing” into another class. Since we focus on black box decision systems for image classification, the explanation obtained from the exemplars also provides a saliency map highlighting the areas of the image that contribute to its classification, and areas of the image that push it into another class. We present the results of an experimental evaluation on three datasets and two black box models. Besides providing the most useful and interpretable explanations, we show that the proposed method outperforms existing explainers in terms of fidelity, relevance, coherence, and stability. JF - Machine Learning and Knowledge Discovery in Databases PB - Springer International Publishing CY - Cham SN - 978-3-030-46150-8 UR - https://link.springer.com/chapter/10.1007/978-3-030-46150-8_12 ER -