19 February 2019 in bioRxiv
High-TMB (TMB-H) could result in an increased number of neoepitopes from somatic mutations expressed by a patient’s own tumor cell which can be recognized and targeted by neighboring tumor-infiltrating lymphocytes (TILs). Deeper understanding of spatial heterogeneity and organization of tumor cells and their neighboring immune infiltrates within tumors could provide new insights into tumor progression and treatment response. Here we developed and applied computational approaches using digital whole slide images (WSIs) to investigate spatial heterogeneity and organization of regions harboring TMB-H tumor cells and TILs within tumors, and its prognostic utility. In experiments using WSIs from The Cancer Genome Atlas bladder cancer (BLCA), our findings show that WSI-based approaches can reliably predict patient-level TMB status and delineate spatial TMB heterogeneity and co-organization with TILs. TMB-H patients with low spatial heterogeneity enriched with high TILs show improved overall survival indicating a prognostic role of spatial TMB and TILs information in BLCA.
18 February 2019 in bioRxiv
Tumor mutation burden (TMB) is a quantitative measurement of how many mutations present in tumor cells from a patient tumor as assessed by next-generation sequencing (NGS) technology. High TMB is used as a predictive biomarker to select patients that likely respond to immunotherapy in many cancer types, thus it is critical to accurately measure TMB for cancer patients who need to receive the immunotherapy. Recent studies showed that image features from histopathology whole slide images can be used to predict genetic features (e.g., mutation status) or clinical outcome of cancer patients. In this study, we develop a computational method to predict the TMB level from cancer patients’ histopathology whole slide images. The prediction problem is formulated as multiple instance learning (MIL) because a whole slide image (a bag) has to be divided into multiple image blocks (instances) due to computational reasons but a single label is available only to an entire whole slide image not to each image block. In particular, we propose a novel heteroscedastic noise model for MIL based on the framework of Gaussian process (GP), where the noise variance is assumed to be a latent function of image level features. This noise variance can encode the confidence in predicting the TMB level from each training image and make the method to put different levels of effort to classify images according to how difficult each image can be correctly classified. The method tries to fit an easier image well while it does not put much effort in classifying a harder (ambiguous) image correctly. Expectation and propagation (EP) is employed to efficiently infer our model and to find the optimal hyper-parameters. We have demonstrated from synthetic and real-world data sets that our method outperforms on TMB prediction from whole slide images base-line methods, including a special case of our method that does not include the heteroscedastic noise modeling and multiple instance ordinal regression (MIOR) that is one of few algorithms to solve ordinal regression in the MIL setting.
20 December 2018 in bioRxiv
Computerized whole slide image analysis is important for assisting pathologists in cancer grading and predicting patient clinical outcomes. However, it is challenging to analyze whole slide image (WSI) at cellular level due to its huge size and nuclear variations. For efficient WSI analysis, this paper presents a general texture descriptor, statistical local binary patterns (SLBP), which is applied to prostate cancer Gleason score prediction from WSI. Unlike traditional local binary patterns (LBP) and many its variants, the presented SLBP encodes local texture patterns via analyzing both median and standard deviation over a regional sampling scheme, so that it can capture more micro- and macro-structure information in the image. Experiments on Gleason score prediction have been performed on 317 different patient cases selected from the cancer genome atlas (TCGA) dataset. The presented SLBP descriptor provides over 80% accuracy on two class (grade <=7 vs grade >=8) distinction, which is superior to traditional texture descriptors such as histogram, Haralick and other state-of-art LBP variants.