Multi-view clustering research is a hot topic in the field of data mining, where complementary information between views can better describe data objects and improve the clustering performance. Non-negative matrix factorization (NMF) based multi-view clustering algorithm suffers from weak feature extraction, slow convergence speed and low accuracy. To solve these problems, this paper proposes a generalized deep learning multi-view clustering (GDLMC) algorithm based on NMF. Firstly, via decoupling the elements in the matrix, the matrix elements are non-negatively restricted using an activation function with a non-negative value domain, and the elements are updated employing stochastic gradient descent with learning rate guidance. Then, the corresponding gradients when the elements update are transformed into generalized weights and generalized biases, followed by combining the generalized weights and generalized biases with activation functions to construct generalized deep learning (GDL). Further, GDL is adopted to learn the corresponding low-dimensional matrix of each view and consensus matrix for obtaining the GDLMC algorithm. In addition, the detailed reasoning of the GDLMC algorithm are given. Finally, extensive experiments are conducted on four public datasets including regular and large-scale datasets, and the experimental results show that GDLMC has significant advantages.
17 March 2022 in IEEE Transactions on Computational Social Systems
The graph regularized nonnegative matrix factorization (GNMF) algorithms have received a lot of attention in the field of machine learning and data mining, as well as the square loss method is commonly used to measure the quality of reconstructed data. However, noise is introduced when data reconstruction is performed; and the square loss method is sensitive to noise, which leads to degradation in the performance of data analysis tasks. To solve this problem, a novel graph regularized sparse NMF (GSNMF) is proposed in this article. To obtain a cleaner data matrix to approximate the high-dimensional matrix, the $l_{1}$ -norm to the low-dimensional matrix is added to achieve the adjustment of data eigenvalues in the matrix and sparsity constraint. In addition, the corresponding inference and alternating iterative update algorithm to solve the optimization problem are given. Then, an extension of GSNMF, namely, graph regularized sparse nonnegative matrix trifactorization (GSNMTF), is proposed, and the detailed inference procedure is also shown. Finally, the experimental results on eight different datasets demonstrate that the proposed model has a good performance.
30 January 2023 in IEEE Transactions on Fuzzy Systems
The main goal of most information quality (IQ)-based measures is to combine data provided by multiple information sources to enhance the quality of information essential for decision makers to perform their tasks. However, there is few work to fuse multi-source information from the perspective of possibility distribution (PD) and use IQ as the evaluation criteria for feature selection. The PD is one of important concepts in possibility theory, which is a generally acknowledged method for describing a kind of uncertain knowledge. In this paper, we propose a novel representation model of possibility distributions based on fuzzy multisets, namely, a possibility distribution information system (PDIS). Then, several IQ measures are defined in the PDIS, including Gini entropy, compatibility, conflict, credibility and separability degrees. In view of this, a minimal-separability-minimal-uncertainty-based unsupervised feature selection algorithm (UmSMU) is designed. The proposed UmSMU can sufficiently fuse multiple possibilistic information. Meanwhile, the selected features maintain as much information as possible while minimizing the uncertainty of information. The experimental results show that the proposed algorithm performs well, especially when it comes to selecting fewer features and improving performance.
12 September 2022 in IEEE Transactions on Big Data
Representing the structural relations between entities, i.e., knowledge graph embedding, which is a method to learn low-dimensional representations of knowledge, has become an increasingly prevalent research orientation in cognitive and human intelligence. It is significant to study how to interrelate, fuse and embed the knowledge graph data from different domains while considering data not shared. In this paper, we propose a model of cross-domain knowledge graph embedding in federated learning (FedCKE), in which entity/relation embedding between different domains can interact securely in the case that data is not shared. In advance of client model training, we present an inter-domain encrypted entity/relation alignment method using the encrypted sample alignment method in vertical federated learning, which can obtain entity/relation intersections between different domains without revealing any triples structure and additional entities/relations in the respective datasets. On the server, we aggregate the same entity/relation embeddings by the association in conjunction with the parameter-secure aggregation method in horizontal federated learning. Experimental results on three real datasets show that the proposed FedCKE model is able to enhance the embedding of different clients (domains).
Background: Skin microorganisms co‐develop with the human body and age influences the skin microenvironment and thus the skin bacterial community.Objectives: To investigate the changes in the skin microbiota during male development.Methods: High‐throughput 16S ribosomal RNA pyrosequencing was utilized to analyze the differences in bacterial composition of the skin in healthy males aged 0–25 years.Results: There were significant differences in facial skin bacterial diversity (Shannon index) and richness (Chao index) among the 4 groups of subjects (p < 0.05). Streptococcus, Staphylococcus, Cutibacterium are dominant in males during growth, and regular changes occur with age after birth. Further analysis of skin bacteria between the 4 groups showed that the bacterial abundance of Cutibacterium acnes and Staphylococcus epidermidis tended to increase with age, and the bacterial abundance of Streptococcus, Rothia mucilaginosa, and Staphylococcus hominis tended to decrease with age.Conclusions: There are some changes in cheek skin bacterial diversity during male development, and there is a relationship between skin bacterial changes and skin development processes.