The lack of justification of the results obtained by artificial intelligence (AI) algorithms has limited their usage in the medical context. To increase the explainability of the existing AI methods, explainable artificial intelligence (XAI) is proposed. We performed a systematic literature review, based on the guidelines proposed by Kitchenham and Charters, of studies that applied XAI methods in X-ray-image-related tasks. We identified 141 studies relevant to the objective of this research from five different databases. For each of these studies, we assessed the quality and then analyzed them according to a specific set of research questions. We determined two primary purposes for X-ray images: the detection of bone diseases and lung diseases. We found that most of the AI methods used were based on a CNN. We identified the different techniques to increase the explainability of the models and grouped them depending on the kind of explainability obtained. We found that most of the articles did not evaluate the quality of the explainability obtained, causing problems of confidence in the explanation. Finally, we identified the current challenges and future directions of this subject and provide guidelines to practitioners and researchers to improve the limitations and the weaknesses that we detected.
The use of eXplainable Artificial Intelligence (XAI) systems has introduced a set of challenges that need resolution. Herein, we focus on how to correctly select an XAI method, an open questions within the field. The inherent difficulty of this task is due to the lack of a ground truth. Several authors have proposed metrics to approximate the fidelity of different XAI methods. These metrics lack verification and have concerning disagreements. In this study, we proposed a novel methodology to verify fidelity metrics, using a well-known transparent model, namely a decision tree. This model allowed us to obtain explanations with perfect fidelity. Our proposal constitutes the first objective benchmark for these metrics, facilitating a comparison of existing proposals, and surpassing existing methods. We applied our benchmark to assess the existing fidelity metrics in two different experiments, each using public datasets comprising 52,000 images. The images from these datasets had a size a 128 by 128 pixels and were synthetic data that simplified the training process. All metric values, indicated a lack of fidelity, with the best one showing a 30 \% deviation from the expected values for perfect explanation. Our experimentation led us to conclude that the current fidelity metrics are not reliable enough to be used in real scenarios. From this finding, we deemed it necessary to development new metrics, to avoid the detected problems, and we recommend the usage of our proposal as a benchmark within the scientific community to address these limitations.
This study presents a method to improve state-of-the-art concave point detection methods as the first step towards effectively segmenting overlapping objects in images. The approach relies on analysing the curvature of the object contour. This method comprises three main steps. First, the original image is preprocessed to obtain the curvature value at each contour point. Second, the regions with higher curvatures are selected and a recursive algorithm is applied to refine previously selected regions. Finally, a concave point is obtained for each region by analysing the relative position of their neighbourhood. Furthermore, the experimental results indicate that improving the detection of concave points leads to better division of clusters. To evaluate the quality of the concave point detection algorithm, a synthetic dataset was constructed to simulate the presence of overlapping objects. This dataset includes the precise location of concave points, which serve as the ground truth for evaluation. As a case study, the performance of a well-known application, such as the splitting of overlapping cells in images of peripheral blood smears samples from patients with sickle cell anaemia, was evaluated. We used the proposed method to detect concave points in cell clusters and then separated these clusters by ellipse fitting.