Current practice in cancer treatment collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent rise of radiomics and pathomics, i.e., the extraction of quantitative features from radiology and histopathology images collected to predict clinical outcomes or guide clinical decisions using artificial intelligence algorithms. Nevertheless, how to combine them into a single multimodal framework is still an open issue. In this work, we develop a multimodal late fusion approach that combines hand-crafted features computed from radiomics, pathomics and clinical data to predict radiotherapy treatment outcomes for non-small-cell lung cancer patients. Within this context, we investigate eight different late fusion rules and two patient-wise aggregation rules leveraging the richness of information given by CT images, whole-slide scans and clinical data. The experiments in leave-one-patient-out cross-validation on an in-house cohort of 33 patients show that the proposed fusion-based multimodal paradigm, with an AUC equal to 90.9%, outperforms each unimodal approach, suggesting that data integration can advance precision medicine. The results also show that late fusion favourably compares against early fusion, another commonly used multimodal approach. As a further contribution, we explore the chance to use a deep learning framework against hand-crafted features. In our scenario characterised by different modalities and a limited amount of data, as it may happen in different areas of cancer research, the results show that the latter is still a viable and effective option for extracting relevant information with respect to the former.
1 September 2021 in Artificial Intelligence in Medicine
Despite the advantages offered by personalized treatments, there is presently no way to predict response to chemoradiotherapy in patients with non-small cell lung cancer (NSCLC). In this exploratory study, we investigated the application of deep learning techniques to histological tissue slides (deep pathomics), with the aim of predicting the response to therapy in stage III NSCLC. We evaluated 35 digitalized tissue slides (biopsies or surgical specimens) obtained from patients with stage IIIA or IIIB NSCLC. Patients were classified as responders (12/35, 34.7%) or non-responders (23/35, 65.7%) based on the target volume reduction shown on weekly CT scans performed during chemoradiation treatment. Digital tissue slides were tested by five pre-trained convolutional neural networks (CNNs)—AlexNet, VGG, MobileNet, GoogLeNet, and ResNet—using a leave-two patient-out cross validation approach, and we evaluated the networks’ performances. GoogLeNet was globally found to be the best CNN, correctly classifying 8/12 responders and 10/11 non-responders. Moreover, Deep-Pathomics was found to be highly specific (TNr: 90.1) and quite sensitive (TPr: 0.75). Our data showed that AI could surpass the capabilities of all presently available diagnostic systems, supplying additional information beyond that currently obtainable in clinical practice. The ability to predict a patient’s response to treatment could guide the development of new and more effective therapeutic AI-based approaches and could therefore be considered an effective and innovative step forward in personalised medicine.
The exponential growth of IoT devices, smartphones, smartwatches, and vehicles equipped with positioning technology, such as Global Positioning System (GPS) modules, has boosted the development of location-based services for several applications in Intelligent Transportation Systems. However, the inherent error of location-based technologies makes it necessary to align the positioning trajectories to the actual underlying road network, a process known as map-matching. To the best of our knowledge, there are no comprehensive tools that allow us to model street networks, conduct topological and spatial analyses of the underlying street graph, perform map-matching processes on GPS point trajectories, and deeply analyse and elaborate these reconstructed trajectories. To address this issue, we present PyTrack, an open-source map-matching-based Python toolbox designed for academics, researchers and practitioners that integrate the recorded GPS coordinates with data provided by the OpenStreetMap, an open-source geographic information system. This manuscript overviews the architecture of the library offering a detailed description of its capabilities and modules. Besides, we provide an introductory guide to getting started with PyTrack covering the most fundamental steps of our framework. For more information on PyTrack, users are encouraged to visit the official repository at https://github.com/cosbidev/PyTrack or the official documentation at https://pytrack-lib.readthedocs.io .
Recent years have witnessed the rise of pathomics as a mean to describe histopathological images with quantitative biomarkers for predictive and prognostic ends, combining digital pathology, omic science and artificial intelligence. This novel research branch is the counterpart of radiomics which pursues the same aims extracting knowledge from radiological images. In this paper, we present the design of a pathomic deep learning-based system to predict the treatment outcome in non-small cell lung cancer patients. We describe the system design and optimization under the condition of limited data and limited training, with corresponding tests. The experimental results show the feasibility of the proposed scalable architecture providing also a comparison between different transfer learning strategies.
The COVID-19 disease caused by the coronavirus SARS-nCoV2 is currently a global public health threat and Italy is one of the countries mostly suffering from this epidemic. It is therefore important to analyze epidemic data, considering also that the government deployed laws limiting the societal activities. We model COVID-19 dynamics with a SIQR (susceptible - infectious - quarantined - recovered) model, where we take into account the temporal variability of its parameters. Particle Swarm Optimization is used to find out the best parameters in the case of Italy and of Italian regions where the epidemic has the greatest impact. The basic reproductive number is estimated by a novel approach that averages out different PSO fits computed considering different temporal time-windows and reducing possible noise in the data. The results on data collected from February 24 to April 24 show that our approach is able to fit the data with low errors and that the basic reproductive number is characterized by a descending trend in time from 3.5 to a value below 1.