Summary: The correlation of different microscopic imaging techniques alongside with microanalytical methods is crucial to better understand biological processes on a subcellular level. For that, micrographs and chemical maps exhibiting both, very different spatial resolution and field‐of‐view but also a highly multimodal content has to be co‐registered. We developed the ImageJ/Fiji plug‐in Correlia that provides an environment for handling multimodal correlative microscopy data. Several linear and nonlinear registration methods using either feature or area‐based similarity measures can flexibly be cascaded to align and warp 2D microscopy data sets. The registration of data sets containing light‐ and electron micrographs as well as chemical maps acquired by secondary‐ion mass spectroscopy and energy‐dispersive X‐ray spectroscopy is demonstrated. Correlia is an open‐source tool developed particularly for the registration and analysis of highly multimodal 2D correlative microscopy data.Lay Description: If a microscopic object is imaged correlatively by two or more different microscopes the acquired micrographs will have to be overlaid accurately using an image‐registration software. In cases of relatively similar image content creating such an overlay is straight‐forward but what if the fields‐of‐view and resolutions of the micrographs differ significantly? What if there are distortions in a micrograph which have to be corrected before creating an overlay? What if furthermore a chemical map shall be overlaid that merely shows regions in which a certain chemical element is present? The rapidly increasing number of applications in correlative microscopy is calling for an easy‐to‐use and flexible image registration software that can deal with these challenges. Having that in mind, we developed Correlia, an ImageJ/Fiji plug‐in that provides an environment for handling multimodal 2D correlative microscopy data‐sets. It allows for creating overlays using different registration algorithms that can flexibly be cascaded. In this paper we describe what is happening ‘under the hood’ and give two example data‐sets from microbiology which were registered using Correlia. Correlia is open source software and available from www.ufz.de/correlia ‐ including introductory examples, as the authors would like to encourage other scientists to process their individual correlative microscopy data using Correlia.
Study Design: Retrospective, mono-centric cohort research study. Objectives: The analysis of cervical sagittal balance parameters is essential for preoperative planning and dependent on the physician’s experience. A fully automated artificial intelligence-based algorithm could contribute to an objective analysis and save time. Therefore, this algorithm should be validated in this study. Methods: Two surgeons measured C2-C7 lordosis, C1-C7 Sagittal Vertical Axis (SVA), C2-C7-SVA, C7-slope and T1-slope in pre- and postoperative lateral cervical X-rays of 129 patients undergoing anterior cervical surgery. All parameters were measured twice by surgeons and compared to the measurements by the AI algorithm consisting of 4 deep convolutional neural networks. Agreement between raters was quantified, among other metrics, by mean errors and single measure intraclass correlation coefficients for absolute agreement. Results: ICC-values for intra- (range: .92-1.0) and inter-rater (.91-1.0) reliability reflect excellent agreement between human raters. The AI-algorithm could determine all parameters with excellent ICC-values (preop:0.80-1.0; postop:0.86-.99). For a comparison between the AI algorithm and 1 surgeon, mean errors were smallest for C1-C7 SVA (preop: −.3 mm (95% CI:-.6 to −.1 mm), post: .3 mm (.0-.7 mm)) and largest for C2-C7 lordosis (preop:-2.2° (−2.9 to −1.6°), postop: 2.3°(-3.0 to −1.7°)). The automatic measurement was possible in 99% and 98% of pre- and postoperative images for all parameters except T1 slope, which had a detection rate of 48% and 51% in pre- and postoperative images. Conclusion: This study validates that an AI-algorithm can reliably measure cervical sagittal balance parameters automatically in patients suffering from degenerative spinal diseases. It may simplify manual measurements and autonomously analyze large-scale datasets. Further studies are required to validate the algorithm on a larger and more diverse patient cohort.
1 January 2007 in Methods of Information in Medicine
Objectives: A proof of principle study was conducted for microscopic tissue volume reconstructions using a new image processing chain operating on alternately stained large histological serial sections. Methods: Digital histological images were obtained from conventional brightfield transmitted light microscopy. A powerful nonparametric nonlinear optical flow-based registration approach was used. In order to apply a simple but computationally feasible sum-of-squared-differences similarity measure even in case of differing histological stainings, a new consistent tissue segmentation procedure was placed upstream. Results: Two reconstructions from uterine cervix carcinoma specimen were accomplished, one alternately stained with p16INK4a (surrogate tumor marker) and H&E (routine reference), and another with three different alternate stainings, H&E, p16INK4a, and CD3 (a T-lymphocyte marker). For both cases, due to our segmentation-based reference-free nonlinear registration procedure, resulting tissue reconstructions exhibit utmost smooth image-to-image transitions without impairing warpings. Conclusions: Our combination of modern nonparametric nonlinear registration and consistent tissue segmentation has turned out to provide a superior tissue reconstruction quality.
For analysis of the tumor microenvironment in diffuse large B-cell lymphoma (DLBCL) tissue samples, it is desirable to obtain information about counts and distribution of different macrophage subtypes. Until now, macrophage counts are mostly inferred from gene expression analysis of whole tissue sections, providing only indirect information. Direct analysis of immunohistochemically (IHC) fluorescence stained tissue samples is confronted with several difficulties, e.g. high variability of shape and size of target macrophages and strongly inhomogeneous intensity of staining. Consequently, application of commercial software is largely restricted to very rough analysis modes, and most macrophage counts are still obtained by manual counting in microarrays or high power fields, thus failing to represent the heterogeneity of tumor microenvironment adequately. We describe a Rudin-Osher-Fatemi (ROF) filter based segmentation approach for whole tissue samples, combining floating intensity thresholding and rule-based feature detection. Method is validated against manual counts and compared with two commercial software kits (Tissue Studio 64, Definiens AG, and Halo, Indica Labs) and a straightforward machine-learning approach in a set of 50 test images. Further, the novel method and both commercial packages are applied to a set of 44 whole tissue sections. Outputs are compared with gene expression data available for the same tissue samples. Finally, the ROF based method is applied to 44 expert-specified tumor subregions for testing selection and subsampling strategies. Among all tested methods, the novel approach is best correlated with manual count (0.9297). Automated detection of evaluation subregions proved to be fully reliable. Comparison with gene expression data obtained for the same tissue samples reveals only moderate to low correlation levels. Subsampling within tumor subregions is possible with results almost identical to full sampling. Mean macrophage size in tumor subregions is 152.5±111.3 μm2. ROF based approach is successfully applied to detection of IHC stained macrophages in DLBCL tissue samples. The method competes well with existing commercial software kits. In difference to them, it is fully automated, externally repeatable, independent on training data and completely documented. Comparison with gene expression data indicates that image morphometry constitutes an independent source of information about antibody-polarized macrophage occurence and distribution.
Passive immunotherapy is a very promising approach for the treatment of Alzheimer’s disease (AD). Among the different antibodies under development, those targeting post-translationally modified Aβ peptides might combine efficient reduction in beta-amyloid accompanied by lower sequestration in peripheral compartments and thus anticipated and reduced treatment-related side effects. In that regard, we recently demonstrated that the antibody-mediated targeting of isoD7-modified Aβ peptides leads to the attenuation of AD-like amyloid pathology in 5xFAD mice. In order to assess novel strategies to enhance the efficacy of passive vaccination approaches, we investigated the role of CD33 for Aβ phagocytosis in transgenic mice treated with an isoD7-Aβ antibody. We crossbred 5xFAD transgenic mice with CD33 knock out (CD33KO) mice and compared the amyloid pathology in the different genotypes of the crossbreds. The knockout of CD33 in 5xFAD mice leads to a significant reduction in Aβ plaques and concomitant rescue of behavioral deficits. Passive immunotherapy of 5xFAD/CD33KO showed a significant increase in plaque-surrounding microglia compared to 5xFAD treated with the antibody. Additionally, we observed a stronger lowering of Aβ plaque load after passive immunotherapy in 5xFAD/CD33KO mice. The data suggest an additive effect of passive immunotherapy and CD33KO in terms of lowering Aβ pathology. Hence, a combination of CD33 antagonists and monoclonal antibodies might represent a strategy to enhance efficacy of passive immunotherapy in AD.