The distribution of tumor-infiltrating lymphocytes (TILs) within the tumor microenvironment provides strong prognostic value, which is increasingly important with the arrival of new immunotherapy modalities. Both visual and image analysis-based assays are developed to assess the immune contexture of the tumors. We propose an automated method based on grid subsampling of microscopy image analysis data to extract the tumor-stroma interface zone (IZ) of controlled width. The IZ is a ranking of tissue areas by their distance to the tumor edge, which is determined by a set of explicit rules. TIL density profiles across the IZ are used to compute a set of novel immunogradient indicators that reflect TIL gradient towards the tumor. We applied the method on CD8 immunohistochemistry images of surgically excised hormone receptor-positive breast and colorectal cancers to predict overall patient survival. In both cohorts, the immunogradient indicators enabled strong and independent prognostic stratification, outperforming clinical and pathologic variables. Patients with breast cancer with low immunogradient levels had a prominent decrease in survival probability 5 years after surgery. Our study provides proof of concept that data-driven, automated, operator-independent IZ sampling enables spatial immune response measurement in the tumor-host interaction frontline for prediction of disease outcomes.

Within the tumor microenvironment, specifically aligned collagen has been shown to stimulate tumor progression by directing the migration of metastatic cells along its structural framework. Tumor-associated collagen signatures (TACS) have been linked to breast cancer patient outcome. Robust and affordable methods for assessing biological information contained in collagen architecture need to be developed. We have developed a novel artificial neural network (ANN) based approach for tumor collagen segmentation from bright-field histology images and have tested it on a set of tissue microarray sections from early hormone receptor-positive invasive ductal breast carcinoma stained with Sirius Red (1 core per patient, n = 92). We designed and trained ANNs on sets of differently annotated image patches to segment collagen fibers and extracted 37 features of collagen fiber morphometry, density, orientation, texture, and fractal characteristics in the entire cohort. Independent instances of ANN models trained on highly differing annotations produced reasonably concordant collagen segmentation masks and allowed reliable prognostic Cox regression models (with likelihood ratios 14.11–22.99, at p-value < 0.05) superior to conventional clinical parameters (size of the primary tumor (T), regional lymph node status (N), histological grade (G), and patient age). Additionally, we noted statistically significant differences of collagen features between tumor grade groups, and the factor analysis revealed features resembling the TACS concept. Our proposed method offers collagen framework segmentation from bright-field histology images and provides novel image-based features for better breast cancer patient prognostication.

Immunohistochemistry (IHC) for ER, PR, HER2, and Ki67 is used to predict outcome and therapy response in breast cancer patients. The current IHC assessment, visual or digital, is based mostly on global biomarker expression levels in the tissue sample. In our study, we explored the prognostic value of digital image analysis of conventional breast cancer IHC biomarkers supplemented with their intratumoral heterogeneity and tissue immune response indicators. Surgically excised tumor samples from 101 female patients with hormone receptor-positive breast cancer (HRBC) were stained for ER, PR, HER2, Ki67, SATB1, CD8, and scanned at 20x. Digital image analysis was performed using the HALO™ platform. Subsequently, hexagonal tiling was used to compute intratumoral heterogeneity indicators for ER, PR and Ki67 expression. Multiple Cox regression analysis revealed three independent predictors of the patient's overall survival: Haralick's texture entropy of PR (HR = 0.19, p = 0.0005), Ki67 Ashman's D bimodality (HR = 3.0, p = 0.01), and CD8+SATB1+ cell density in tumor tissue (HR = 0.32, p = 0.02). Remarkably, the PR and Ki67 intratumoral heterogeneity indicators were prognostically more informative than the rates of their expression. In particular, a distinct non-linear relationship between the rate of PR expression and its intratumoral heterogeneity was observed and revealed a non-linear prognostic effect of PR expression. The independent prognostic significance of CD8+SATB1+ cells infiltrating the tumor could indicate their role in anti-tumor immunity. In conclusion, we suggest that prognostic modeling, based entirely on the computational image-based IHC biomarkers, is possible in HRBC patients. The intratumoral heterogeneity and immune response indicators outperformed both conventional breast cancer IHC and clinicopathological variables while markedly increasing the power of the model.

Hepatocellular carcinoma (HCC) often emerges in the setting of long-standing inflammatory liver disease. CD8 lymphocytes are involved in both the antitumoral response and hepatocyte damage in the remaining parenchyma. We investigated the dual role of CD8 lymphocytes by assessing density profiles at the interfaces of both HCC and perineoplastic liver parenchyma with surrounding stroma in whole-slide immunohistochemistry images of surgical resection samples. We applied a hexagonal grid-based digital image analysis method to sample the interface zones and compute the CD8 density profiles within them. The prognostic value of the indicators was explored in the context of clinicopathological, peripheral blood testing, and surgery data. Independent predictors of worse OS were a low standard deviation of CD8+ density along the tumor edge, high mean CD8+ density within the epithelial aspect of the perineoplastic liver-stroma interface, longer duration of surgery, a higher level of aspartate transaminase (AST), and a higher basophil count in the peripheral blood. A combined score, derived from these five independent predictors, enabled risk stratification of the patients into three prognostic categories with a 5-year OS probability of 76%, 40%, and 8%. Independent predictors of longer RFS were stage pT1, shorter duration of surgery, larger tumor size, wider tumor-free margin, and higher mean CD8+ density in the epithelial aspect of the tumor-stroma interface. We conclude that (1) our computational models reveal independent and opposite prognostic impacts of CD8+ cell densities at the interfaces of the malignant and non-malignant epithelium interfaces with the surrounding stroma; and (2) together with pathology, surgery, and laboratory data, comprehensive prognostic models can be constructed to predict patient outcomes after liver resection due to HCC.

Breast cancer (BC) categorized as human epidermal growth factor receptor 2 (HER2) borderline [2+ by immunohistochemistry (IHC 2+)] presents challenges for the testing, frequently obscured by intratumoral heterogeneity (ITH). This leads to difficulties in therapy decisions. We aimed to establish prognostic models of overall survival (OS) of these patients, which take into account spatial aspects of ITH and tumor microenvironment by using hexagonal tiling analytics of digital image analysis (DIA). In particular, we assessed the prognostic value of Immunogradient indicators at the tumor–stroma interface zone (IZ) as a feature of antitumor immune response. Surgical excision samples stained for estrogen receptor (ER), progesterone receptor (PR), Ki67, HER2, and CD8 from 275 patients with HER2 IHC 2+ invasive ductal BC were used in the study. DIA outputs were subsampled by HexT for ITH quantification and tumor microenvironment extraction for Immunogradient indicators. Multiple Cox regression revealed HER2 membrane completeness (HER2 MC) (HR: 0.18, p = 0.0007), its spatial entropy (HR: 0.37, p = 0.0341), and ER contrast (HR: 0.21, p = 0.0449) as independent predictors of better OS, with worse OS predicted by pT status (HR: 6.04, p = 0.0014) in the HER2 non-amplified patients. In the HER2-amplified patients, HER2 MC contrast (HR: 0.35, p = 0.0367) and CEP17 copy number (HR: 0.19, p = 0.0035) were independent predictors of better OS along with worse OS predicted by pN status (HR: 4.75, p = 0.0018). In the non-amplified tumors, three Immunogradient indicators provided the independent prognostic value: CD8 density in the tumor aspect of the IZ and CD8 center of mass were associated with better OS (HR: 0.23, p = 0.0079 and 0.14, p = 0.0014, respectively), and CD8 density variance along the tumor edge predicted worse OS (HR: 9.45, p = 0.0002). Combining these three computational indicators of the CD8 cell spatial distribution within the tumor microenvironment augmented prognostic stratification of the patients. In the HER2-amplified group, CD8 cell density in the tumor aspect of the IZ was the only independent immune response feature to predict better OS (HR: 0.22, p = 0.0047). In conclusion, we present novel prognostic models, based on computational ITH and Immunogradient indicators of the IHC biomarkers, in HER2 IHC 2+ BC patients.