The traditional Frost filter is improved by the adaptive windowing and adaptive tuning factor for the synthetic aperture radar (SAR) images in this letter. The proposed double-adaptive Frost filter simultaneously makes the window size and the tuning factor adaptively adjusted in terms of the regional characteristics, leading to an effective balance between speckle suppression and edge preservation. The despeckling experiments on the simulated and real SAR images demonstrate that in comparison to the Lee filter, the Gamma maximum a posteriori (MAP) filter, the traditional Frost filter, and the Frost filter only with the adaptive tuning factor, the double-adaptive Frost filter sufficiently suppresses the speckle in homogeneous regions and in edge regions and effectively preserves the edges and fine details.
Road segmentation for synthetic aperture radar (SAR) images is of great practical significance. With the rapid development and wide application of SAR imaging technology, this problem has attracted much attention. At present, there are numerous road segmentation methods. This paper analyzes and summarizes the road segmentation methods for SAR images over the years. Firstly, the traditional road segmentation algorithms are classified according to the degree of automation and the principle. Advantages and disadvantages are introduced successively for each traditional method. Then, the popular segmentation methods based on deep learning in recent years are systematically introduced. Finally, novel deep segmentation neural networks based on the capsule paradigm and the self-attention mechanism are forecasted as future research for SAR images.
Accurate nuclear instance segmentation and classification in histopathologic images are the foundation of cancer diagnosis and prognosis. Several challenges are restricting the development of accurate simultaneous nuclear instance segmentation and classification. Firstly, the visual appearances of different category nuclei could be similar, making it difficult to distinguish different types of nuclei. Secondly, it is thorny to separate highly clustering nuclear instances. Thirdly, rare current studies have considered the global dependencies among diverse nuclear instances. In this article, we propose a novel deep learning framework named TSHVNet which integrates multiattention modules (i.e., Transformer and SimAM) into the state‐of‐the‐art HoVer‐Net for the sake of a more accurate nuclear instance segmentation and classification. Specifically, the Transformer attention module is employed on the trunk of the HoVer‐Net to model the long‐distance relationships of diverse nuclear instances. The SimAM attention modules are deployed on both the trunk and branches to apply the 3D channel and spatial attention to assign neurons with appropriate weights. Finally, we validate the proposed method on two public datasets: PanNuke and CoNSeP. The comparison results have shown the outstanding performance of the proposed TSHVNet network among the state‐of‐art methods. Particularly, as compared to the original HoVer‐Net, the performance of nuclear instance segmentation evaluated by the PQ index has shown 1.4% and 2.8% increases on the CoNSeP and PanNuke datasets, respectively, and the performance of nuclear classification measured by F1_score has increased by 2.4% and 2.5% on the CoNSeP and PanNuke datasets, respectively. Therefore, the proposed multiattention‐based TSHVNet is of great potential in simultaneous nuclear instance segmentation and classification.
Feature matching is a core step in multi-source remote sensing image registration approaches based on feature. However, for existing methods, whether traditional classical SIFT algorithm or deep learning-based methods, they essentially rely on generating descriptors from local regions of feature points, which can lead to low matching success rates due to various challenges, including gray-scale changes, content changes, local similarity, and occlusions between images. Inspired by the human approach of finding rough corresponding regions globally and then carefully comparing local regions, and the excellent global attention property of transformers, the proposed feature matching network adopts a coarse-to-fine matching strategy that utilizes both global and local information between images to predict corresponding feature points. Importantly, the network has great flexibility of matching corresponding points for any feature points and can be effectively trained without strong supervised signals of corresponding feature points and only require the true geometric transformation between images. The qualitative experiment illustrate the effectiveness of the proposed network by matching feature points extracted by SIFT or sampled uniformly. In the quantitative experiments, we used feature points extracted by SIFT, SuperPoint, and LoFTR as the keypoints to be matched. We then calculated the mean match success ratio (MSR) and mean reprojection error (MRE) of each method at different thresholds in the test dataset. Additionally, boxplot graphs were plotted to visualize the distributions. By comparing the MSR and MRE values as well as their distributions with other methods, we can conclude that the proposed method consistently outperforms the comparison methods in terms of MSR at different thresholds. Moreover, the MSR of the proposed method remains within a reasonable range compared to the MRE of other methods.
GF-3 satellite is China's first C-band multi-polarized synthetic aperture radar (SAR) satellite with the 1-meter resolution, which has been widely used in various fields. Road detection for GF-3 SAR images is an important part of the application of GF-3, especially in fields of map update, target recognition, and image matching. However, speckle appears in GF-3 SAR images due to coherent imaging system and it hinders the interpretation of images seriously. Especially the detection of weak roads under strong speckle background becomes extremely difficult. As a representative of multiscale geometric analysis (MGA) tool, shearlet has the optimal sparse representation feature and strong directional orientation, which can effectively capture edge and other anisotropic feature information, and can accurately describe the sparse characteristics of GF-3 SAR images. Based on shearlet, a method for detecting weak roads under strong speckle interference is proposed. Firstly, the Frost filter is used for despeckling. Secondly, shearlet is used for road detection. Finally, morphological operations are adopted to obtain the final result. Road detection experiments on various types of GF-3 SAR images demonstrate that, the proposed method can effectively overcome the interference of speckle, and completely and smoothly detect road information, which is very suitable for the detection of weak roads under strong speckle interference of GF-3 SAR images.
Chinese paintings have great cultural and artistic significance and are known for their delicate lines and rich textures. Unfortunately, many ancient paintings have been damaged due to historical and natural factors. The deep learning methods that are successful in restoring natural images cannot be applied to the inpainting of ancient paintings. Thus, we propose a model named Edge-MSGAN for inpainting Chinese ancient paintings based on edge guidance and multi-scale residual blocks. The Edge-MSGAN utilizes edge images to direct the completion network in order to generate entire ancient paintings. It then applies the multi-branch color correction network to adjust the colors. Furthermore, the model uses multi-scale channel attention residual blocks to learn the semantic features of ancient paintings at various levels. At the same time, by using polarized self-attention, the model can improve its concentration on significant structures, edges, and details, which leads to paintings that possess clear lines and intricate details. Finally, we have created a dataset for ancient paintings inpainting, and have conducted experiments in order to evaluate the model’s performance. After comparing the proposed model with state-of-the-art models from qualitative and quantitative aspects, it was found that our model is better at inpainting the texture, edge, and color of ancient paintings. Therefore, our model achieved maximum PSNR and SSIM values of 34.7127 and 0.9280 respectively, and minimum MSE and LPIPS values of 0.0006 and 0.0495, respectively.