Background: During a pandemic, it is important for clinicians to stratify patients and decide who receives limited medical resources. Machine learning models have been proposed to accurately predict COVID-19 disease severity. Previous studies have typically tested only one machine learning algorithm and limited performance evaluation to area under the curve analysis. To obtain the best results possible, it may be important to test different machine learning algorithms to find the best prediction model. Objective: In this study, we aimed to use automated machine learning (autoML) to train various machine learning algorithms. We selected the model that best predicted patients’ chances of surviving a SARS-CoV-2 infection. In addition, we identified which variables (ie, vital signs, biomarkers, comorbidities, etc) were the most influential in generating an accurate model. Methods: Data were retrospectively collected from all patients who tested positive for COVID-19 at our institution between March 1 and July 3, 2020. We collected 48 variables from each patient within 36 hours before or after the index time (ie, real-time polymerase chain reaction positivity). Patients were followed for 30 days or until death. Patients’ data were used to build 20 machine learning models with various algorithms via autoML. The performance of machine learning models was measured by analyzing the area under the precision-recall curve (AUPCR). Subsequently, we established model interpretability via Shapley additive explanation and partial dependence plots to identify and rank variables that drove model predictions. Afterward, we conducted dimensionality reduction to extract the 10 most influential variables. AutoML models were retrained by only using these 10 variables, and the output models were evaluated against the model that used 48 variables. Results: Data from 4313 patients were used to develop the models. The best model that was generated by using autoML and 48 variables was the stacked ensemble model (AUPRC=0.807). The two best independent models were the gradient boost machine and extreme gradient boost models, which had an AUPRC of 0.803 and 0.793, respectively. The deep learning model (AUPRC=0.73) was substantially inferior to the other models. The 10 most influential variables for generating high-performing models were systolic and diastolic blood pressure, age, pulse oximetry level, blood urea nitrogen level, lactate dehydrogenase level, D-dimer level, troponin level, respiratory rate, and Charlson comorbidity score. After the autoML models were retrained with these 10 variables, the stacked ensemble model still had the best performance (AUPRC=0.791). Conclusions: We used autoML to develop high-performing models that predicted the survival of patients with COVID-19. In addition, we identified important variables that correlated with mortality. This is proof of concept that autoML is an efficient, effective, and informative method for generating machine learning–based clinical decision support tools.

Objective: The image quality in whole slide imaging (WSI) is one of the most important issues for the practical use of WSI scanners. In this paper, we proposed an image quality evaluation method for scanned slide images in which no reference image is required. Methods: While most of the conventional methods for no-reference evaluation only deal with one image degradation at a time, the proposed method is capable of assessing both blur and noise by using an evaluation index which is calculated using the sharpness and noise information of the images in a given training data set by linear regression analysis. The linear regression coefficients can be determined in two ways depending on the purpose of the evaluation. For objective quality evaluation, the coefficients are determined using a reference image with mean square error as the objective value in the analysis. On the other hand, for subjective quality evaluation, the subjective scores given by human observers are used as the objective values in the analysis. The predictive linear regression models for the objective and subjective image quality evaluations, which were constructed using training images, were then used on test data wherein the calculated objective values are construed as the evaluation indices. Results: The results of our experiments confirmed the effectiveness of the proposed image quality evaluation method in both objective and subjective image quality measurements. Finally, we demonstrated the application of the proposed evaluation method to the WSI image quality assessment and automatic rescanning in the WSI scanner.

The establishment of whole-slide imaging (WSI) as a medical diagnostic device allows that pathologists may evaluate mitotic activity with this new technology. Furthermore, the image digitalization provides an opportunity to develop algorithms for automatic quantifications, ideally leading to improved reproducibility as compared to the naked eye examination by pathologists. In order to implement them effectively, accuracy of mitotic figure detection using WSI should be investigated. In this study, we aimed to measure pathologist performance in detecting mitotic figures (MFs) using multiple platforms (multiple scanners) and compare the results with those obtained using a brightfield microscope. Four slides of canine oral melanoma were prepared and digitized using 4 WSI scanners. In these slides, 40 regions of interest (ROIs) were demarcated, and five observers identified the MFs using different viewing modes: microscopy and WSI. We evaluated the inter- and intra-observer agreements between modes with Cohen’s Kappa and determined “true” MFs with a consensus panel. We then assessed the accuracy (agreement with truth) using the average of sensitivity and specificity. In the 40 ROIs, 155 candidate MFs were detected by five pathologists; 74 of them were determined to be true MFs. Inter- and intra-observer agreement was mostly “substantial” or greater (Kappa = 0.594–0.939). Accuracy was between 0.632 and 0.843 across all readers and modes. After averaging over readers for each modality, we found that mitosis detection accuracy for 3 of the 4 WSI scanners was significantly less than that of the microscope (p = 0.002, 0.012, and 0.001). This study is the first to compare WSIs and microscopy in detecting MFs at the level of individual cells. Our results suggest that WSI can be used for mitotic cell detection and offers similar reproducibility to the microscope, with slightly less accuracy.

<!-- *** Custom HTML *** --> Human epidermal growth factor receptor 2 (HER2), a transmembrane tyrosine kinase receptor encoded by the ERBB2 gene on chromosome 17q12, is a predictive and prognostic biomarker in invasive breast cancer (BC). Approximately 20% of BC are HER2-positive as a result of ERBB2 gene amplification and overexpression of the HER2 protein. Quantification of HER2 is performed routinely on all invasive BCs, to assist in clinical decision making for prognosis and treatment for HER2-positive BC patients by manually counting gene signals. We propose an automated system to quantify the HER2 gene status from chromogenic in situ hybridization (CISH) whole slide images (WSI) in invasive BC. The proposed method selects untruncated and nonoverlapped singular nuclei from the cancer regions using color unmixing and machine learning techniques. Then, HER2 and chromosome enumeration probe 17 (CEP17) signals are detected based on the RGB intensity and counted per nucleus. Finally, the HER2-to-CEP17 signal ratio is calculated to determine the HER2 amplification status following the ASCO/CAP 2018 guidelines. The proposed method reduced the labor and time for the quantification. In the experiment, the correlation coefficient between the proposed automatic CISH quantification method and pathologist manual enumeration was 0.98. The p-values larger than 0.05 from the one-sided paired t-test ensured that the proposed method yields statistically indifferent results to the reference method. The method was established on WSI scanned by two different scanners. Through the experiments, the capability of the proposed system has been demonstrated.