Quantitative Evaluation of White & Black Box Interpretability Methods for Image Classification

• Autores: Stanchi, Oscar Agustín; Ronchetti, Franco; Dal Bianco, Pedro Alejandro; Ríos, Gastón Gustavo; Hasperué, Waldo; Puig Valls, Domenec; Rashwan, Hatem; Quiroga, Facundo Manuel
• Año de publicación: 2024
• Idioma: inglés
• Tipo de recurso: documento de conferencia
• Materia: Ciencias Informáticas; Ablation; Black Box; Computer Vision; Deep Learning; Interpretability; Quantitative Measure; White Box
• Institución: Universidad Nacional de La Plata

The field of interpretability in Deep Learning faces significant challenges due to the lack of standard metrics for systematically evaluating and comparing interpretability methods. The absence of quantifiable measures impedes practitioners ability to select the most suitable methods and models for their specific tasks. To address this issue, we propose the Pixel Erosion and Dilation Score, a novel metric designed to assess the robustness of model explanations. Our approach involves applying iterative erosion and dilation processes to heatmaps generated by various interpretability methods, thereby using them to hide and show the important regions of a image to the network, allowing for a coherent and interpretable evaluation of model decision-making processes. We conduct quantitative ablation tests using our metric on the ImageNet dataset with both VGG16 and ResNet18 models. The results reveal that our new measure provides a numerical and intuitive means for comparing interpretability methods and models, facilitating more informed decision-making for practitioner.
Red de Universidades con Carreras en Informática