Artificial intelligence (AI) systems have been shown to help dermatologists diagnose melanoma more accurately, however they lack transparency, hindering user acceptance. Explainable AI (XAI) methods can help to increase transparency, yet often lack precise, domain-specific explanations. Moreover, the impact of XAI methods on dermatologists’ decisions has not yet been evaluated. Building upon previous research, we introduce an XAI system that provides precise and domain-specific explanations alongside its differential diagnoses of melanomas and nevi. Through a three-phase study, we assess its impact on dermatologists’ diagnostic accuracy, diagnostic confidence, and trust in the XAI-support. Our results show strong alignment between XAI and dermatologist explanations. We also show that dermatologists’ confidence in their diagnoses, and their trust in the support system significantly increase with XAI compared to conventional AI. This study highlights dermatologists’ willingness to adopt such XAI systems, promoting future use in the clinic.
Due to their ability to solve complex problems, deep neural networks (DNNs) are becoming increasingly popular in medical applications. However, decision-making by such algorithms is essentially a black-box process that renders it difficult for physicians to judge whether the decisions are reliable. The use of explainable artificial intelligence (XAI) is often suggested as a solution to this problem. We investigate how XAI is used for skin cancer detection: how is it used during the development of new DNNs? What kinds of visualisations are commonly used? Are there systematic evaluations of XAI with dermatologists or dermatopathologists? Google Scholar, PubMed, IEEE Explore, Science Direct and Scopus were searched for peer-reviewed studies published between January 2017 and October 2021 applying XAI to dermatological images: the search terms histopathological image, whole-slide image, clinical image, dermoscopic image, skin, dermatology, explainable, interpretable and XAI were used in various combinations. Only studies concerned with skin cancer were included. 37 publications fulfilled our inclusion criteria. Most studies (19/37) simply applied existing XAI methods to their classifier to interpret its decision-making. Some studies (4/37) proposed new XAI methods or improved upon existing techniques. 14/37 studies addressed specific questions such as bias detection and impact of XAI on man-machine-interactions. However, only three of them evaluated the performance and confidence of humans using CAD systems with XAI. XAI is commonly applied during the development of DNNs for skin cancer detection. However, a systematic and rigorous evaluation of its usefulness in this scenario is lacking.
Until recently, distant metastatic melanoma was considered refractory to systemic therapy. A better understanding of the interactions between tumors and the immune system and the mechanisms of regulation of T-cells led to the development of immune checkpoint inhibitors. This review summarizes the current novel data on the treatment of metastatic melanoma with anti-programmed cell death protein 1 (PD-1) antibodies and anti-PD-1-based combination regimens, including clinical trials presented at major conference meetings. Immune checkpoint inhibitors, in particular anti-PD-1 antibodies such as pembrolizumab and nivolumab and the combination of nivolumab with the anti-cytotoxic T-lymphocyte-associated protein 4 (CTLA-4) antibody ipilimumab can achieve long-term survival for patients with metastatic melanoma. The anti-PD-1 antibodies nivolumab and pembrolizumab were also approved for adjuvant treatment of patients with resected metastatic melanoma. Anti-PD-1 antibodies appear to be well tolerated, and toxicity is manageable. Nivolumab combined with ipilimumab achieves a 5 year survival rate of more than 50% but at a cost of high toxicity. Ongoing clinical trials investigate novel immunotherapy combinations and strategies (e.g., Talimogene laherparepvec (T-VEC), Bempegaldesleukin (BEMPEG), incorporation or sequencing of targeted therapy, incorporation or sequencing of radiotherapy), and focus on poor prognosis groups (e.g., high tumor burden/LDH levels, anti-PD-1 refractory melanoma, and brain metastases).
2 July 2021 in Journal of Medical Internet Research
Background: Recent years have been witnessing a substantial improvement in the accuracy of skin cancer classification using convolutional neural networks (CNNs). CNNs perform on par with or better than dermatologists with respect to the classification tasks of single images. However, in clinical practice, dermatologists also use other patient data beyond the visual aspects present in a digitized image, further increasing their diagnostic accuracy. Several pilot studies have recently investigated the effects of integrating different subtypes of patient data into CNN-based skin cancer classifiers. Objective: This systematic review focuses on the current research investigating the impact of merging information from image features and patient data on the performance of CNN-based skin cancer image classification. This study aims to explore the potential in this field of research by evaluating the types of patient data used, the ways in which the nonimage data are encoded and merged with the image features, and the impact of the integration on the classifier performance. Methods: Google Scholar, PubMed, MEDLINE, and ScienceDirect were screened for peer-reviewed studies published in English that dealt with the integration of patient data within a CNN-based skin cancer classification. The search terms skin cancer classification, convolutional neural network(s), deep learning, lesions, melanoma, metadata, clinical information, and patient data were combined. Results: A total of 11 publications fulfilled the inclusion criteria. All of them reported an overall improvement in different skin lesion classification tasks with patient data integration. The most commonly used patient data were age, sex, and lesion location. The patient data were mostly one-hot encoded. There were differences in the complexity that the encoded patient data were processed with regarding deep learning methods before and after fusing them with the image features for a combined classifier. Conclusions: This study indicates the potential benefits of integrating patient data into CNN-based diagnostic algorithms. However, how exactly the individual patient data enhance classification performance, especially in the case of multiclass classification problems, is still unclear. Moreover, a substantial fraction of patient data used by dermatologists remains to be analyzed in the context of CNN-based skin cancer classification. Further exploratory analyses in this promising field may optimize patient data integration into CNN-based skin cancer diagnostics for patients’ benefits.
This decade has brought significant survival improvement in patients with metastatic melanoma with targeted therapies and immunotherapies. As our understanding of the mechanisms of action of these therapeutics evolves, even more impressive therapeutic success is being achieved through various combination strategies, including combinations of different immunotherapies as well as with other modalities. This review summarizes prospectively and retrospectively generated clinical evidence on modern melanoma therapy, focusing on immunotherapy and targeted therapy with BRAF kinase inhibitors and MEK kinase inhibitors (BRAF/MEK inhibitors), including recent data presented at major conference meetings. The combination of the anti-PD-1 directed monoclonal antibody nivolumab and of the CTLA-4 antagonist ipilimumab achieves unprecedented 5-year overall survival (OS) rates above 50%; however, toxicity is high. For PD-1 monotherapy (nivolumab or pembrolizumab), toxicities are in general well manageable. Today, novel combinations of such immune checkpoint inhibitors (ICIs) are under investigation, for example with cytokines and oncolytic viruses (i.e., pegylated interleukin-2, talimogene laherparepvec). Furthermore, current studies investigate the combined or sequential use of ICIs plus BRAF/MEK inhibitors. Several studies focus particularly on poor prognosis patients, as e.g., on anti-PD-1 refractory melanoma, patients with brain metastases, or uveal melanoma. It is hoped, on the road to cure, that these new approaches further improve long term survival in patients with advanced or metastatic melanoma.
13 December 2019 in Journal of the European Academy of Dermatology and Venereology
Considering the rising incidence, cutaneous squamous‐cell carcinoma (cSCC) has a high clinical relevance. In patients with localized cSCC, complete surgical resection is indicated. Radiotherapy should be performed in patients with non‐resectable tumours or in patients who are not suitable for surgery. Systemic therapy is reserved for cSCC that are neither surgically nor radiotherapeutically curable due to their extensive local spread and/or local or distant metastasis. In the absence of prospective randomized phase 3 trials to evaluate and compare the efficacy and safety of chemotherapeutics, epidermal growth factor receptor (EGFR) inhibitors and anti‐PD‐1 antibodies, no final recommendation for systemic therapy can be given for patients with locally advanced or metastatic cSCC. Anti‐PD‐1 antibodies currently show promising results with response rates of up to 50% in both locally advanced and metastatic cSCC. Anti‐PD‐1 antibodies appear to achieve higher response rates compared with EGFR inhibitors, and the duration of response appears to be superior to both chemotherapy and EGFR inhibitors. Compared with chemotherapy, the side effect profile of anti‐PD‐1 antibodies appears to be favourable. Altogether, PD‐1 inhibitors are expected to become the new standard of care for patients with locally advanced and metastatic cSCC. Currently, placebo‐controlled clinical trials are investigating the adjuvant use of cemiplimab and pembrolizumab in patients undergoing resection and radiotherapy of high‐risk cSCC. Patients not eligible for anti‐PD‐1 treatment, e.g. in organ transplant recipients, or in patients refractory to anti‐PD‐1 may be offered EGFR inhibitors and/or chemotherapies. Chemotherapies appear to be superior to EGFR inhibitors in terms of response rates, whereas EGFR inhibitors have a more favourable toxicity profile. EGFR inhibitors are therefore more suitable for multimorbid and/or frail elderly patients. By combining EGFR inhibitors with local therapy such as surgery or radiotherapy, response rates and duration of response may be improved.