16 November 2021 in IEEE Transactions on Neural Networks and Learning Systems
Large-scale undirected weighted networks are frequently encountered in big-data-related applications concerning interactions among a large unique set of entities. Such a network can be described by a Symmetric, High-Dimensional, and Incomplete (SHDI) matrix whose symmetry and incompleteness should be addressed with care. However, existing models fail in either correctly representing its symmetry or efficiently handling its incomplete data. For addressing this critical issue, this study proposes an Alternating-Direction-Method of Multipliers (ADMM)-based Symmetric Non-negative Latent Factor Analysis (ASNL) model. It adopts fourfold ideas: 1) implementing the data density-oriented modeling for efficiently representing an SHDI matrix's incomplete and imbalanced data; 2) separating the non-negative constraints from the decision parameters to avoid truncations during the training process; 3) incorporating the ADMM principle into its learning scheme for fast model convergence; and 4) parallelizing the training process with load balance considerations for high efficiency. Empirical studies on four SHDI matrices demonstrate that ASNL significantly outperforms several state-of-the-art models in both prediction accuracy for missing data of an SHDI and computational efficiency. It is a promising model for handling large-scale undirected networks raised in real applications.
29 July 2020 in IEEE Transactions on Big Data
Symmetric high-dimensional and sparse (SHiDS) networks are frequently found in various industrial applications. A symmetric non-negative latent factor (SNLF) model can acquire essential features from them precisely, yet it suffers from slow convergence. To address this issue, this article integrates a generalized momentum method into a symmetric, single latent factor-dependent, non-negative and multiplicative update (S 2 LF-NMU) algorithm, thereby achieving a m omentum-incorporated, s ymmetric, s ingle-latent-factor-dependent n on-negative-multiplicative-update (MS 2 N) algorithm. Based on an MS 2 N algorithm, momentum-incorporated symmetric non-negative latent factor (MSNLF) models are proposed for an SHiDS network, which ensures fast convergence as well as high representative learning ability. Empirical studies on four SHiDS networks from industrial applications demonstrate that compared with state-of-the-art models, the proposed MSNLF models have significantly higher computational efficiency and representative learning ability.