Pathology images contain rich information of cell appearance, microenvironment, and topology features for cancer analysis and diagnosis. Among such features, topology becomes increasingly important in analysis for cancer immunotherapy. By analyzing geometric and hierarchically structured cell distribution topology, oncologists can identify densely-packed and cancer-relevant cell communities (CCs) for making decisions. Compared to commonly-used pixel-level Convolution Neural Network (CNN) features and cell-instance-level Graph Neural Network (GNN) features, CC topology features are at a higher level of granularity and geometry. However, topological features have not been well exploited by recent deep learning (DL) methods for pathology image classification due to lack of effective topological descriptors for cell distribution and gathering patterns. In this paper, inspired by clinical practice, we analyze and classify pathology images by comprehensively learning cell appearance, microenvironment, and topology in a fine-to-coarse manner. To describe and exploit topology, we design Cell Community Forest (CCF), a novel graph that represents the hierarchical formulation process of big-sparse CCs from small-dense CCs. Using CCF as a new geometric topological descriptor of tumor cells in pathology images, we propose CCF-GNN, a GNN model that successively aggregates heterogeneous features (e.g., appearance, microenvironment) from cell-instance-level, cell-community-level, into image-level for pathology image classification. Extensive cross-validation experiments show that our method significantly outperforms alternative methods on H&E-stained and immunofluorescence images for disease grading tasks with multiple cancer types. Our proposed CCF-GNN establishes a new topological data analysis (TDA) based method, which facilitates integrating multi-level heterogeneous features of point clouds (e.g., for cells) into a unified DL framework.
In three dimensional profilometry, phase retrieval technique plays a key role in signal processing stage. Fringe images need to be transformed into phase information to obtain the measurement result. In this paper, a new phase retrieval method based on deep learning technique is proposed for interferometry. Different from conventional multi-step phase shift methods, phase information can be extracted from only a single frame of an interferogram by this method. Here, the phase retrieval task is regarded as a regression problem and a hypercolumns convolutional neural network is constructed to solve it. Firstly, functions and each component of the network model are introduced in details; Then, four different mathematical functions are adopted to generate the training dataset; training and validation strategies are also designed subsequently; Finally, optimization processing is performed to eliminate local data defects in initial results with the help of polynomial fitting. In addition, hardware platform based on point diffraction interferometer is fabricated to support this method. Concluded from the experiment section, the proposed method possesses a desirable performance in terms of phase retrieval, denoising and time efficiency.
23 December 2024 in Advanced Engineering Informatics
We report a phase-shifting method based on a pinhole point diffraction interferometer. Using the random two-frame phase-shifting algorithm, the piezo electric transducer (PZT) drives the pinhole moving a certain step length along the axis of the tested aspheric mirror. In each step, the CCD collects an interferogram. Then two interferograms are processed by the phase-shifting algorithm. After that, we can acquire the phase map of the interferograms. This technique has great potential for increasing the measuring aperture of the aspheric mirror in the pinhole point diffraction interferometer (PPDI) under the premise of keeping the advantages of PPDI of which the optic devices, as well as error sources, are few behind the substrate.