High-dimensional and sparse (HiDS) matrices are frequently adopted to describe the complex relationships in various big data-related systems and applications. A Position-transitional Latent Factor Analysis (PLFA) model can accurately and efficiently represent an HiDS matrix. However, its involved latent factors are optimized by particle-swarm-optimization-incorporated stochastic gradient descent with the specific gradient direction step-by-step, which may cause a suboptimal solution. To address this issue, this paper proposes a Sequential-Group-Differential-Evolution (SGDE) algorithm to refine the latent factors optimized by a PLFA model, thereby achieving a highly-accurate SGDE-PLFA model to HiDS matrices. The main idea of SGDE-PLFA is two-fold. First, it divides the obtained latent factors by PLFA into row and column sub-groups to ensure the efficient low-dimensional optimization. Second, it initializes and optimizes these sub-group latent factors with our improved Differential Evolution algorithm to search more accurate solutions nearby the suboptimum. As demonstrated by the extensive experiments on four HiDS matrices, an SGDE-PLFA model outperforms the state-of-the-art models in representing HiDS matrices.
29 January 2024 in IEEE Transactions on Geoscience and Remote Sensing
With the prosperity of deep learning techniques, salient object detection in remote sensing images (RSI-SOD) is concomitantly in full flourishing. However, due to the inherent challenges such as uncertainty in object quantities and scales, cluttered backgrounds, and blurred edges arising from shadows, most current approaches struggle for salient feature learning with the aid of heavy model architecture, yet often result in barely satisfactory performance. Some methods compromise model complexity to improve efficiency, albeit with significantly degraded results. To earn a satisfactory balance of efficacy and efficiency, we propose a new network for RSI-SOD, namely SFANet, based on progressive semantic flow and uncertainty-aware refinement. Specifically, we design a global semantic enhancement block (GSEB) to reduce background interference and accurately localize salient objects of varying quantities and scales, which further consists of three modularized components, i.e., semantic extraction module (SEM), interscale fusion module (IFM), and deep semantic graph-inference module (DSGM). SEM together with IFM contributes to the effective aggregation of multi-scale contexts by extracting fused and progressive semantic cues. DSGM performs semantic inference to better localize salient objects with irregularities in scale and topological structure. Furthermore, we present an uncertainty-aware refinement module (URM) to recognize salient objects in cluttered backgrounds and effectively suppress shadows. Extensive experiments are conducted on three RSI-SOD datasets, from which superior results can be achieved by our SFANet, outperforming the other cutting-edge methods. The code is available at https://github.com/ZhengJianwei2/SFANet.
13 October 2023 in IEEE Transactions on Neural Networks and Learning Systems
High-dimensional and incomplete (HDI) data are frequently encountered in big date-related applications for describing restricted observed interactions among large node sets. How to perform accurate and efficient representation learning on such HDI data is a hot yet thorny issue. A latent factor (LF) model has proven to be efficient in addressing it. However, the objective function of an LF model is nonconvex. Commonly adopted first-order methods cannot approach its second-order stationary point, thereby resulting in accuracy loss. On the other hand, traditional second-order methods are impractical for LF models since they suffer from high computational costs due to the required operations on the objective’s huge Hessian matrix. In order to address this issue, this study proposes a generalized Nesterov-accelerated second-order LF (GNSLF) model that integrates twofold conceptions: 1) acquiring proper second-order step efficiently by adopting a Hessian-vector algorithm and 2) embedding the second-order step into a generalized Nesterov’s acceleration (GNA) method for speeding up its linear search process. The analysis focuses on the local convergence for GNSLF’s nonconvex cost function instead of the global convergence has been taken; its local convergence properties have been provided with theoretical proofs. Experimental results on six HDI data cases demonstrate that GNSLF performs better than state-of-the-art LF models in accuracy for missing data estimation with high efficiency, i.e., a second-order model can be accelerated by incorporating GNA without accuracy loss.
4 March 2024 in IEEE Transactions on Emerging Topics in Computational Intelligence
Dynamic Quality-of-Service (QoS) data can be efficiently represented by a Non-negative Latent-factorization-of-tensors model, which relies on a Non-negative and Multiplicative Update on Incomplete Tensors (NMU-IT) algorithm. Nevertheless, NMU-IT frequently encounters slow convergence and inefficient hyper-parameters selection. Targeting at overcome these critical defects, this paper proposed to improve the NMU-IT algorithm from two perspectives: a) integrating a generalized Nesterov's accelerated gradient method to accelerate the resultant model's convergence rate, and b) establishing the hyper-parameter adaptation mechanism through the particle swarm optimization strategy. On the basis of these conceptions, this study successfully builds a G eneralized Nesterov's Accelerated Gradient-incorporated N on-negative L atent-factorization-of-tensors (GNL) model for precisely and high-efficiently representing the dynamic QoS data. The proposed GNL model has shown its superiority over several advanced models concerning both the precision of estimating missing QoS data and training efficiency, as demonstrated by the experiments conducted on two dynamic QoS datasets.
Sustainable urban water management is crucial for meeting the growing demands of urban populations. This study presents a novel approach that combines time series clustering, seasonal analysis, and entropy analysis to uncover residential water consumption patterns and their drivers. Using a three-year dataset from the SmartH2o project, encompassing 374 households, we identify nine distinct water consumption patterns through time series clustering, leveraging Dynamic Time Warping (DTW) as the optimal similarity measure. Multiple linear regression reveals key household characteristics influencing water usage behaviors, such as the number of bathrooms and appliance efficiency ratings. Seasonal analysis uncovers temporal dynamics, highlighting shifts towards lower consumption during summer months and increased variability in transitional seasons. Entropy analysis quantifies the diversity and complexity of water consumption at both cluster and household levels, informing targeted interventions. This comprehensive, granular approach enables the development of personalized water conservation strategies and policies, empowering water utilities to optimize resource management and contribute to sustainable urban water practices.
30 March 2021 in Mathematical Problems in Engineering
Short-time heavy rainfall is a kind of sudden strong and heavy precipitation weather, which seriously threatens people’s life and property safety. Accurate precipitation nowcasting is of great significance for the government to make disaster prevention and mitigation decisions in time. In order to make high-resolution forecasts of regional rainfall, this paper proposes a convolutional 3D GRU (Conv3D-GRU) model to predict the future rainfall intensity over a relatively short period of time from the machine learning perspective. Firstly, the spatial features of radar echo maps with different heights are extracted by 3D convolution, and then, the radar echo maps on time series are coded and decoded by using GRU. Finally, the trained model is used to predict the radar echo maps in the next 1-2 hours. The experimental results show that the algorithm can effectively extract the temporal and spatial features of radar echo maps, reduce the error between the predicted value and the real value of rainfall, and improve the accuracy of short-term rainfall prediction.