The Cell Tracking Challenge is an ongoing benchmarking initiative that has become a reference in cell segmentation and tracking algorithm development. Here, we present a significant number of improvements introduced in the challenge since our 2017 report. These include the creation of a new segmentation-only benchmark, the enrichment of the dataset repository with new datasets that increase its diversity and complexity, and the creation of a silver standard reference corpus based on the most competitive results, which will be of particular interest for data-hungry deep learning-based strategies. Furthermore, we present the up-to-date cell segmentation and tracking leaderboards, an in-depth analysis of the relationship between the performance of the state-of-the-art methods and the properties of the datasets and annotations, and two novel, insightful studies about the generalizability and the reusability of top-performing methods. These studies provide critical practical conclusions for both developers and users of traditional and machine learning-based cell segmentation and tracking algorithms.
Small extracellular vesicles (sEVs) are cell-derived vesicles of nanoscale size (~30–200 nm) that function as conveyors of information between cells, reflecting the cell of their origin and its physiological condition in their content. Valuable information on the shape and even on the composition of individual sEVs can be recorded using transmission electron microscopy (TEM). Unfortunately, sample preparation for TEM image acquisition is a complex procedure, which often leads to noisy images and renders automatic quantification of sEVs an extremely difficult task. We present a completely deep-learning-based pipeline for the segmentation of sEVs in TEM images. Our method applies a residual convolutional neural network to obtain fine masks and use the Radon transform for splitting clustered sEVs. Using three manually annotated datasets that cover a natural variability typical for sEV studies, we show that the proposed method outperforms two different state-of-the-art approaches in terms of detection and segmentation performance. Furthermore, the diameter and roundness of the segmented vesicles are estimated with an error of less than 10%, which supports the high potential of our method in biological applications.
Optical microscopy is an indispensable tool in life sciences research, but conventional techniques require compromises between imaging parameters like speed, resolution, field of view and phototoxicity. To overcome these limitations, data‐driven microscopes incorporate feedback loops between data acquisition and analysis. This review overviews how machine learning enables automated image analysis to optimise microscopy in real time. We first introduce key data‐driven microscopy concepts and machine learning methods relevant to microscopy image analysis. Subsequently, we highlight pioneering works and recent advances in integrating machine learning into microscopy acquisition workflows, including optimising illumination, switching modalities and acquisition rates, and triggering targeted experiments. We then discuss the remaining challenges and future outlook. Overall, intelligent microscopes that can sense, analyse and adapt promise to transform optical imaging by opening new experimental possibilities.
Tissue stiffness is a critical prognostic factor in breast cancer and is associated with metastatic progression. Here we show an alternative and complementary hypothesis of tumor progression whereby physiologic matrix stiffness affects the quantity and protein cargo of small extracellular vesicles (EV) produced by cancer cells, which in turn aid cancer cell dissemination. Primary patient breast tissue released by cancer cells on matrices that model human breast tumors (25 kPa; stiff EVs) feature increased adhesion molecule presentation (ITGα2β1, ITGα6β4, ITGα6β1, CD44) compared with EVs from softer normal tissue (0.5 kPa; soft EVs), which facilitates their binding to extracellular matrix proteins including collagen IV, and a 3-fold increase in homing ability to distant organs in mice. In a zebrafish xenograft model, stiff EVs aid cancer cell dissemination. Moreover, normal, resident lung fibroblasts treated with stiff and soft EVs change their gene expression profiles to adopt a cancer-associated fibroblast phenotype. These findings show that EV quantity, cargo, and function depend heavily on the mechanical properties of the extracellular microenvironment. Significance: Here we show that the quantity, cargo, and function of breast cancer–derived EVs vary with mechanical properties of the extracellular microenvironment.