Device-free localization (DFL), as an emerging technology that locates targets without any attached devices via wireless sensor networks, has spawned extensive applications in the Internet of Things (IoT) field. For DFL, a key problem is how to extract significant features to characterize raw signals with different patterns associated with different locations. To address this problem, in this paper, the DFL problem is formulated as an image classification problem. Moreover, we design a three-layer convolutional autoencoder (CAE) neural network to perform unsupervised feature extraction from raw signals followed by supervised fine-tuning for classification. The CAE combines the advantages of a convolutional neural network (CNN) and a deep autoencoder (AE) in the feature learning and signals reconstruction, which is expected to achieve good performance for DFL. The experimental results show that the proposed approach can achieve a high localization accuracy rate of 100% for a reasonable grid size on the raw real-world data, i.e., the collected raw data without added Gaussian noise, and is robust to noisy data with a signal-to-noise ratio greater than -5 dB. Additionally, its time cost for the classification of a single activity is 4 ms, which is fast enough for the IoT applications. The proposed approach outperforms the deep CNN and AE in terms of localization accuracy and robust ability against noise.
Deep reinforcement learning (DRL), which highly depends on the data representation, has shown its potential in many practical decision-making problems. However, the process of acquiring representations in DRL is easily affected by interference from models, and moreover leaves unnecessary parameters, leading to control performance reduction. In this article, we propose a double sparse DRL via multilayer sparse coding and nonconvex regularized pruning. To alleviate interference in DRL, we propose a multilayer sparse-coding-structural network to obtain deep sparse representation for control in reinforcement learning. Furthermore, we employ a nonconvex log regularizer to promote strong sparsity, efficiently removing the unnecessary weights with a regularizer-based pruning scheme. Hence, a double sparse DRL algorithm is developed, which can not only learn deep sparse representation to reduce the interference but also remove redundant weights while keeping the robust performance. The experimental results in five benchmark environments of the deep $q$ network (DQN) architecture demonstrate that the proposed method with deep sparse representations from the multilayer sparse-coding structure can outperform existing sparse-coding-based DRL in control, for example, completing Mountain Car with 140.81 steps, achieving near 10% reward increase from the single-layer sparse-coding DRL algorithm, and obtaining 286.08 scores in Catcher, which are over two times the rewards of the other algorithms. Moreover, the proposed algorithm can reduce over 80% parameters while keeping performance improvements from deep sparse representations.
11 October 2021 in IEEE Transactions on Neural Networks and Learning Systems
Direct-optimization-based dictionary learning has attracted increasing attention for improving computational efficiency. However, the existing direct optimization scheme can only be applied to limited dictionary learning problems, and it remains an open problem to prove that the whole sequence obtained by the algorithm converges to a critical point of the objective function. In this article, we propose a novel direct-optimization-based dictionary learning algorithm using the minimax concave penalty (MCP) as a sparsity regularizer that can enforce strong sparsity and obtain accurate estimation. For solving the corresponding optimization problem, we first decompose the nonconvex MCP into two convex components. Then, we employ the difference of the convex functions algorithm and the nonconvex proximal-splitting algorithm to process the resulting subproblems. Thus, the direct optimization approach can be extended to a broader class of dictionary learning problems, even if the sparsity regularizer is nonconvex. In addition, the convergence guarantee for the proposed algorithm can be theoretically proven. Our numerical simulations demonstrate that the proposed algorithm has good convergence performances in different cases and robust dictionary-recovery capabilities. When applied to sparse approximations, the proposed approach can obtain sparser and less error estimation than the different sparsity regularizers in existing methods. In addition, the proposed algorithm has robustness in image denoising and key-frame extraction.
Global navigation satellite systems (GNSS) provide efficient positioning services for location-aware Internet of Things (IoT) devices. However, GNSS non-line-of-sight (NLOS) signals can result in severe positioning errors in urban canyon areas. Existing deep learning-based NLOS signal classification methods cannot appropriately model the spatiotemporal information of NLOS interference, resulting in limited accuracy across multiple locations. This study presents a spatiotemporal information-driven model that can capture environmental characteristics and signal temporal information simultaneously to improve NLOS classification accuracy across multiple locations. First, a visualization analysis of the signal distribution across multiple locations demonstrates the impact of environmental characteristics. In addition, the significance of both the spatial environmental features and the signal temporal features for NLOS classification is clarified by constructing a tree diagram of the dataset. Second, we propose an airspace attention mechanism module and a long short-term memory (LSTM)-based temporal feature extraction module to model both types of features, respectively. Third, the learnable sparse regularizer is utilized to reduce feature redundancy and thereby realize a sparse representation, which improves model generalization performance. Finally, the spatiotemporal information-driven cross-attention model is developed to perform NLOS classification, which uses a cross-attention fusion strategy to integrate the two modules. We use real-world datasets collected across multiple urban canyon locations to test our model. Experiments show that the proposed model can achieve 98% classification accuracy across multiple locations. Generalization performance in unknown environments can be improved over 7% compared to several state-of-the-art models.
Convolutional transform learning (CTL), learning filters by minimizing the data fidelity loss function in an unsupervised way, is becoming very pervasive, resulting from keeping the best of both worlds: the benefit of unsupervised learning and the success of the convolutional neural network. There have been growing interests in developing efficient CTL algorithms. However, developing a convergent and accelerated CTL algorithm with accurate representations simultaneously with proper sparsity is an open problem. This article presents a new CTL framework with a $log$ regularizer that can not only obtain accurate representations but also yield strong sparsity. To efficiently address our nonconvex composite optimization, we propose to employ the proximal difference of the convex algorithm (PDCA) which relies on decomposing the nonconvex regularizer into the difference of two convex parts and then optimizes the convex subproblems. Furthermore, we introduce the extrapolation technology to accelerate the algorithm, leading to a fast and efficient CTL algorithm. In particular, we provide a rigorous convergence analysis for the proposed algorithm under the accelerated PDCA. The experimental results demonstrate that the proposed algorithm can converge more stably to desirable solutions with lower approximation error and simultaneously with stronger sparsity and, thus, learn filters efficiently. Meanwhile, the convergence speed is faster than the existing CTL algorithms.
7 March 2022 in IEEE Transactions on Neural Networks and Learning Systems
Multiview dictionary learning (DL) is attracting attention in multiview clustering due to the efficient feature learning ability. However, most existing multiview DL algorithms are facing problems in fully utilizing consistent and complementary information simultaneously in the multiview data and learning the most precise representation for multiview clustering because of gaps between views. This article proposes an efficient multiview DL algorithm for multiview clustering, which uses the partially shared DL model with a flexible ratio of shared sparse coefficients to excavate both consistency and complementarity in the multiview data. In particular, a differentiable scale-invariant function is used as the sparsity regularizer, which considers the absolute sparsity of coefficients as the $\ell _{0}$ norm regularizer but is continuous and differentiable almost everywhere. The corresponding optimization problem is solved by the proximal splitting method with extrapolation technology; moreover, the proximal operator of the differentiable scale-invariant regularizer can be derived. The synthetic experiment results demonstrate that the proposed algorithm can recover the synthetic dictionary well with reasonable convergence time costs. Multiview clustering experiments include six real-world multiview datasets, and the performances show that the proposed algorithm is not sensitive to the regularizer parameter as the other algorithms. Furthermore, an appropriate coefficient sharing ratio can help to exploit consistent information while keeping complementary information from multiview data and thus enhance performances in multiview clustering. In addition, the convergence performances show that the proposed algorithm can obtain the best performances in multiview clustering among compared algorithms and can converge faster than compared multiview algorithms mostly.