3 March 2023 in IEEE Transactions on Emerging Topics in Computational Intelligence
High quality medical images are not only an important basis for doctors to carry out clinical diagnosis and treatment, but also conducive to downstream tasks such as image analysis. Although many medical image enhancement methods have achieved good results, some of them still have shortcomings in homogenizing illumination distribution and maintaining texture details, and even introduce boundary artifact noise. In order to deal with these problems, this paper proposes a multi-scale attention generative adversarial network (MAGAN) for medical image enhancement, which is suitable for unpaired images. Our MAGAN is trained in the confrontation between two generators and two discriminators. It tries to fuse multi-scale information in feature extraction by establishing feature pyramid, and filters irrelevant activation to highlight important regions based on attention distribution, which is positive for imaging. Moreover, MAGAN strengthens the constraints on the quality of enhanced image from the perspectives of illumination distribution, texture details, deep semantic features and smoothness, so as to improve the enhancement effect. Compared with six state-of-the-art methods, the experimental results show that MAGAN has the most significant image enhancement effect, and also performs best in the downstream task of image segmentation.
22 April 2023 in Information Sciences
18 May 2023 in IEEE Transactions on Fuzzy Systems
The ensemble of fuzzy clustering can address the problems presented in the base clustering, such as fluctuations in results due to random initialization and performance degradation due to outliers. However, the performance of fuzzy clustering ensembles is still hampered by some challenges that include misaligned membership matrices, loss of information in the co-similarity matrix, large storage space, unstable ensemble results due to an additional re-clustering, the need for original data information for assistance, etc. To address these issues, we propose a parameter-free robust ensemble framework for fuzzy clustering. After obtaining the set of membership matrices, we cascade these membership matrices and mine the latent spectral matrix of the raw data. Benefiting from this step, we obtain global features of the dataset without knowing the specific data. Then, our framework uses transition matrices to solve the alignment problem, avoiding the storage of large-scale matrices. Most importantly, we introduce a robust weighted mechanism in the optimization model, where each base clustering is adaptively adjusted and the effect of outliers is suppressed by a robust function. In addition, the model yields the results as a membership matrix, which produces the exact partition results directly without any subsequent clustering operations. Finally, since our model is a parameter-free model, the setting of hyper-parameters is avoided and the applicability of the model is improved as well. The effective algorithm of the optimization model is derived and its time complexity and convergence are analyzed. The results of competitive experiments on benchmark data show that the proposed ensemble framework is effective compared to state-of-the-art methods.
16 July 2021 in IEEE Transactions on Geoscience and Remote Sensing
Tensor-based robust principal component analysis (PCA) methods are efficient to discover the low-rank part of a hyperspectral image for reducing redundant information and guarantee good classification results. However, current methods cannot remove noise adequately, and the residual noise remaining in the low-rank image limits the further improvement of classification performance. Thus, enhancing the robustness to noise is important and helpful for tensor-based robust PCA (RPCA) methods to process hyperspectral images. To this end, we propose a tensor-based RPCA method with a locality preserving graph and frontal slice sparsity (LPGTRPCA) for hyperspectral image classification. Specifically, a tensor $l_{2,2,1}$ norm that requires the frontal slice sparsity of a tensor is defined to extract the noise in the hyperspectral image from the frontal direction. What is more, a position-based Laplacian graph that preserves the local structures of a tensor according to the spatial position is designed for relieving the impact of the residual noise remaining in the low-rank image. Based on the tensor nuclear norm, the tensor $l_{2,2,1}$ norm, and the position-based Laplacian graph, LPGTRPCA efficiently separates the low-rank part with little noise from a raw hyperspectral image and achieves more robust classification results than current methods. LPGTRPCA is optimized by the alternative direction multiplier method (ADMM), and the convergence of solutions is experimentally demonstrated. In the experiments conducted on Indian Pines, Pavia University, and Salinas datasets, LPGTRPCA outperformed various state-of-the-art and classical tensor-based RPCA methods in terms of average class classification accuracy (AA), overall classification accuracy (OA), and kappa coefficient (KC).
11 July 2022 in IEEE Transactions on Fuzzy Systems
Categorical data is widely available in many real-world applications, and to discover valuable patterns in such data by clustering is of great importance. However, the lack of a decent quantitative relationship among categorical values makes traditional clustering approaches, which are usually developed for numerical data, perform poorly on categorical datasets. To solve this problem and boost the performance of clustering for categorical data, we propose a novel fuzzy clustering model in this paper. At first, by approximating the Maximum A Posteriori (MAP) estimation of a discrete distribution of data partition, a new fuzzy clustering objective function is designed for categorical data. The Bayesian dissimilarity measure is formulated in this objective to tackle the subtle relationships between categorical values efficiently. Then, to further enhance the performance of clustering, a novel Kullback-Leibler (KL) divergence-based graph regularization is integrated into the clustering objective to exploit the prior knowledge on datasets, for example, the information about correlations of data points. The proposed model is solved by the alternative optimization and the experimental results on the synthetic and real-world datasets show that it outperforms the classical and relevant state-of-the-art algorithms. We also present the parameter analysis of our approach, and conduct a comprehensive study on the effectiveness of the Bayesian dissimilarity measure and the KL divergence-based graph regularization.
27 November 2020 in IEEE Transactions on Fuzzy Systems
The traditional collaborative fuzzy clustering can effectively perform data clustering in distributed peer-to-peer networks, which is an impossible task to complete for the centralized clustering methods due to privacy and security requirements or network transmission technology constraints. But it will increase the number of clustering iterations and lead to lower efficiency of the clustering. Moreover, the collaborative mechanism hidden in the iterative process of clustering cannot be well revealed and explained. In this article, a novel series of transfer collaborative fuzzy clustering algorithms are proposed to solve these issues. In the first basic algorithm, the transfer learning among neighbor nodes vividly expresses the collaborative mechanism and enhances the information collaboration to accelerate the convergence of fuzzy clustering. Meanwhile, neighbor nodes can learn the knowledge from each other to further promote their respective clustering performance. Then, an improved version, with the learning-rate-adjustable strategy instead of fixed values, is designed to highlight the different influence between neighbor nodes, and the appropriate learning rates between neighbor nodes are achieved to ensure the stable clustering accuracy. Finally, two extended versions with the attribute-weight-entropy regularization technique are presented for the clustering of high dimensional sparse data and the extraction of important subspace features. Experiments show the efficiency of the proposed algorithms compared with the related prototype-based clustering methods.