BrAInVision: A hybrid explainable Artificial Intelligence framework for brain MRI analysis

Brain tumors pose a significant medical challenge, characterized by high incidence and mortality rates, which underscore the critical need for accurate and early diagnosis using minimally invasive techniques such as magnetic resonance imaging. In this context, Artificial Intelligence has emerged as a promising tool to enhance diagnostic precision and efficiency. However, its widespread adoption in clinical practice remains limited due to the opacity of Artificial Intelligence-driven decision-making processes. To address this challenge, we introduce BrAInVision, a hybrid and doubly explainable AI framework for brain tumor detection. The novelty of our approach is the integration of both deep learning and traditional machine learning techniques, combining deep-extracted features with hand-crafted features to create a more robust and interpretable classification system. In contrast to conventional single-explanation methods, our framework provides comprehensive explainability through a multi-level analytical approach, enhancing both interpretability and transparency. The first level employs Grad-CAM to visualize regions of interest identified by the deep feature extractor, while the second level utilizes Permutation Feature Importance and Partial Dependence Plots to understand and quantify the contribution of specific image characteristics to diagnostic decisions. The proposed framework achieved an F1-score of 97% on the four classes (Glioma/Meningioma/Pituitary/NoTumor) and an average 99% in binary classification (Glioma/NoTumor), outperforming current state-of-the-art methods. The proposed approach has been validated on both the original dataset and an independent dataset with radiologist-annotated tumor masks, demonstrating strong generalizability. Designed for seamless integration into radiologists’ workflows as a decision support system, BrAInVision ensures a high degree of explainability, thereby fostering greater trust in AI-assisted medical decision-making.