The analysis of microscopy images has always been an important yet time consuming process in materials science. Convolutional Neural Networks (CNNs) have been very successfully used for a number of tasks, such as image segmentation. However, training a CNN requires a large amount of hand annotated data, which can be a problem for material science data. We present a procedure to generate synthetic data based on ad hoc parametric data modelling for enhancing generalization of trained neural network models. Especially for situations where it is not possible to gather a lot of data, such an approach is beneficial and may enable to train a neural network reasonably. Furthermore, we show that targeted data generation by adaptively sampling the parameter space of the generative models gives superior results compared to generating random data points.
Conventional optical systems for quality inspection often encounter limitations due to the constraints of standard image processing pipelines. The customization required for these systems to function in a production environment is not only laborious and costly, but also lacks versatility for various inspection challenges. In this paper, we introduce an Artificial Intelligence (AI)-powered, adaptable toolbox for Visual Quality Inspection. Our toolbox employs divide-and-conquer methodologies, simplifying intricate tasks into manageable sub-problems that can be addressed with established AI techniques. A user-friendly interface facilitates process monitoring and data collection at the production level, enhancing the AI processing. This innovative strategy promotes the digitization of knowledge via sub-problem annotation, offering a reusable and transferable solution for future Industry 4.0 scenarios. We showcase the efficacy and flexibility of our AI-centric quality inspection approach in different real-world production scenarios.
Epidermal growth factor receptor 2 (ErbB2) is found overexpressed in several cancers, such as gastric, and breast cancer, and is, therefore, an important therapeutic target. ErbB2 plays a central role in cancer cell invasiveness, and is associated with cytoskeletal reorganization. In order to study the spatial correlation of single ErbB2 proteins and actin filaments, we applied correlative fluorescence microscopy, and scanning transmission electron microscopy (STEM) to image specifically labeled SKBR3 breast cancer cells. The breast cancer cells were grown on microchips, transformed to express an actin-green fluorescent protein (GFP) fusion protein, and labeled with quantum dot (QD) nanoparticles attached to specific anti-ErbB2 Affibodies. Fluorescence microscopy was performed to identify cellular regions with spatially correlated actin and ErbB2 expression. For STEM of the intact plasma membrane of whole cells, the cells were fixed and covered with graphene. Spatial distribution patterns of ErbB2 in the actin rich ruffled membrane regions were examined, and compared to adjacent actin-low regions of the same cell, revealing an association of putative signaling active ErbB2 homodimers with actin-rich regions. ErbB2 homodimers were found absent from actin-low membrane regions, as well as after treatment of cells with Cytochalasin D, which breaks up larger actin filaments. In both latter data sets, a significant inter-label distance of 36 nm was identified, possibly indicating an indirect attachment to helical actin filaments via the formation of heterodimers of ErbB2 with epidermal growth factor receptor (EGFR). The possible attachment to actin filaments was further explored by identifying linear QD-chains in actin-rich regions, which also showed an inter-label distance of 36 nm.