Hyperspectral fluorescence imaging is gaining popularity for it enables multiplexing of spatio-temporal dynamics across scales for molecules, cells and tissues with multiple fluorescent labels. This is made possible by adding the dimension of wavelength to the dataset. The resulting datasets are high in information density and often require lengthy analyses to separate the overlapping fluorescent spectra. Understanding and visualizing these large multi-dimensional datasets during acquisition and pre-processing can be challenging. Here we present Spectrally Encoded Enhanced Representations (SEER), an approach for improved and computationally efficient simultaneous color visualization of multiple spectral components of hyperspectral fluorescence images. Exploiting the mathematical properties of the phasor method, we transform the wavelength space into information-rich color maps for RGB display visualization. We present multiple biological fluorescent samples and highlight SEER’s enhancement of specific and subtle spectral differences, providing a fast, intuitive and mathematical way to interpret hyperspectral images during collection, pre-processing and analysis.
Protein dimerization and oligomerization are essential to most cellular functions, yet measurement of the size of these oligomers in live cells, especially when their size changes over time and space, remains a challenge. A commonly used approach for studying protein aggregates in cells is number and brightness (N&B), a fluorescence microscopy method that is capable of measuring the apparent average number of molecules and their oligomerization (brightness) in each pixel from a series of fluorescence microscopy images. We have recently expanded this approach in order to allow resampling of the raw data to resolve the statistical weighting of coexisting species within each pixel. This feature makes enhanced N&B (eN&B) optimal for capturing the temporal aspects of protein oligomerization when a distribution of oligomers shifts toward a larger central size over time. In this protocol, we demonstrate the application of eN&B by quantifying receptor clustering dynamics using electron-multiplying charge-coupled device (EMCCD)-based total internal reflection microscopy (TIRF) imaging. TIRF provides a superior signal-to-noise ratio, but we also provide guidelines for implementing eN&B in confocal microscopes. For each time point, eN&B requires the acquisition of 200 frames, and it takes a few seconds up to 2 min to complete a single time point. We provide an eN&B (and standard N&B) MATLAB software package amenable to any standard confocal or TIRF microscope. The software requires a high-RAM computer (64 Gb) to run and includes a photobleaching detrending algorithm, which allows extension of the live imaging for more than an hour.
The expansion of fluorescence bioimaging toward more complex systems and geometries requires analytical tools capable of spanning widely varying timescales and length scales, cleanly separating multiple fluorescent labels and distinguishing these labels from background autofluorescence. Here we meet these challenging objectives for multispectral fluorescence microscopy, combining hyperspectral phasors and linear unmixing to create Hybrid Unmixing (HyU). HyU is efficient and robust, capable of quantitative signal separation even at low illumination levels. In dynamic imaging of developing zebrafish embryos and in mouse tissue, HyU was able to cleanly and efficiently unmix multiple fluorescent labels, even in demanding volumetric timelapse imaging settings. HyU permits high dynamic range imaging, allowing simultaneous imaging of bright exogenous labels and dim endogenous labels. This enables coincident studies of tagged components, cellular behaviors and cellular metabolism within the same specimen, providing more accurate insights into the orchestrated complexity of biological systems.
Hyperspectral endoscopic imaging has the potential to enhance clinical diagnostics and outcome. Most commercial endoscopes utilize imaging fiber bundles to transmit the collected signal from the patient to the medical operator. These bundles consist of several fiber cores surrounded by a cladding layer creating comb structure-like artifacts, which complicate further analysis, both spatially and spectrally. Here we present an optical fiber pattern removal algorithm which we applied to hyperspectral bronchoscopic images robustly and quantitatively without the need for specific optical or electrical hardware. We validate the performance of the pattern removal by using a novel hyperspectral phasor approach. This algorithm can be generalized to all forms of fiber bundle hyperspectral endoscopy.
20 July 2019 in Annual Review of Biomedical Data Science
Embryonic development is highly complex and dynamic, requiring the coordination of numerous molecular and cellular events at precise times and places. Advances in imaging technology have made it possible to follow developmental processes at cellular, tissue, and organ levels over time as they take place in the intact embryo. Parallel innovations of in vivo probes permit imaging to report on molecular, physiological, and anatomical events of embryogenesis, but the resulting multidimensional data sets pose significant challenges for extracting knowledge. In this review, we discuss recent and emerging advances in imaging technologies, in vivo labeling, and data processing that offer the greatest potential for jointly deciphering the intricate cellular dynamics and the underlying molecular mechanisms. Our discussion of the emerging area of “image-omics” highlights both the challenges of data analysis and the promise of more fully embracing computation and data science for rapidly advancing our understanding of biology.
5 July 2024 in Proceedings of the National Academy of Sciences
Only 30% of embryos from in vitro fertilized oocytes successfully implant and develop to term, leading to repeated transfer cycles. To reduce time-to-pregnancy and stress for patients, there is a need for a diagnostic tool to better select embryos and oocytes based on their physiology. The current standard employs brightfield imaging, which provides limited physiological information. Here, we introduce METAPHOR: Metabolic Evaluation through Phasor-based Hyperspectral Imaging and Organelle Recognition. This non-invasive, label-free imaging method combines two-photon illumination and AI to deliver the metabolic profile of embryos and oocytes based on intrinsic autofluorescence signals. We used it to classify i) mouse blastocysts cultured under standard conditions or with depletion of selected metabolites (glucose, pyruvate, lactate); and ii) oocytes from young and old mouse females, or in vitro-aged oocytes. The imaging process was safe for blastocysts and oocytes. The METAPHOR classification of control vs. metabolites-depleted embryos reached an area under the ROC curve (AUC) of 93.7%, compared to 51% achieved for human grading using brightfield imaging. The binary classification of young vs. old/in vitro-aged oocytes and their blastulation prediction using METAPHOR reached an AUC of 96.2% and 82.2%, respectively. Finally, organelle recognition and segmentation based on the flavin adenine dinucleotide signal revealed that quantification of mitochondria size and distribution can be used as a biomarker to classify oocytes and embryos. The performance and safety of the method highlight the accuracy of noninvasive metabolic imaging as a complementary approach to evaluate oocytes and embryos based on their physiology.