23 June 2023 in IEEE Transactions on Affective Computing
EEG emotion recognition plays a significant role in various mental health services. Deep learning-based methods perform excellently, but still suffer from interpretability. Although methods such as Gradient-weighted Class Activation Mapping(Grad-CAM) can cope with the above problem, their coarse granularity cannot accurately reveal the mechanism to promote emotional intelligence. In this paper, fine-grained interpretability is proposed, called Concat-aided Grad-CAM. Specifically, the multi-level feature mapping before the fully connected layer is concatenated to obtain the gradients of the target concept so that the discriminant information can be directly located in the high-precision area. Unlike coarse-grained interpretability methods applied in EEG emotion recognition, it can accurately highlight the EEG channels related to emotion rather than an obscure area. In addition, a systematic brain functional network is proposed to reveal the relationship between those channels and to further improve emotion recognition performance. The channels with greater contributions are connected, and those connections are learned by dynamic graph convolutional networks, while the others are independent to eliminate interference. Experiments on two EEG emotion recognition datasets manifest that Concat-aided Grad-CAM can be interpreted by the fine-grained. In addition, it has been shown that the learned brain functional network can improve the performance of the baselines. Significantly, the experiment results achieve state-of-the-art performance in subject-dependent experiments.
4 April 2024 in IEEE Transactions on Neural Networks and Learning Systems
The dynamic neural network (DNN), in contrast to the static counterpart, offers numerous advantages, such as improved accuracy, efficiency, and interpretability. These benefits stem from the network’s flexible structures and parameters, making it highly attractive and applicable across various domains. As the broad learning system (BLS) continues to evolve, DNNs have expanded beyond deep learning (DL), orienting a more comprehensive range of domains. Therefore, this comprehensive review article focuses on two prominent areas where DNN structures have rapidly developed: 1) DL and 2) broad learning. This article provides an in-depth exploration of the techniques related to dynamic construction and inference. Furthermore, it discusses the applications of DNNs in diverse domains while also addressing open issues and highlighting promising research directions. By offering a comprehensive understanding of DNNs, this article serves as a valuable resource for researchers, guiding them toward future investigations.
27 April 2022 in International Journal of Machine Learning and Cybernetics
21 May 2024 in IEEE Transactions on Artificial Intelligence
Broad learning system (BLS) has to undergo a vectorization operation before modeling image data, which makes it challenging for BLS to learn local semantic features. Thus, various convolutional-based broad learning systems (C-BLS) have been introduced to address these challenges. Regrettably, the existing C-BLS variants either lack an efficient training algorithm and incremental learning capability or suffer from poor performance. To this end, we propose a novel convolutional broad learning system (ConvBLS) based on the spherical K-means (SKM) algorithm and two-stage multi-scale (TSMS) feature fusion, which consists of the convolutional feature layer (CFL), convolutional enhancement layer (CEL), TSMS feature fusion layer, and output layer. First, unlike the current C-BLS, the simple yet efficient SKM algorithm is utilized to learn the weights of CFLs. Compared with random filters, the SKM algorithm enables the CFL to learn more comprehensive spatial features. Second, to further mine the local semantic features, CELs are established to expand the feature space. Third, the TSMS feature fusion layer is proposed to extract more effective multi-scale features by integrating deep and broad representations. Thanks to the above elaborate design and the pseudo-inverse calculation of the output layer weights, our proposed ConvBLS method is unprecedentedly efficient and effective. Finally, the corresponding incremental learning algorithms are presented for rapid remodeling if the model deems to expand. Experiments and comparisons demonstrate the superiority of our method.
8 September 2021 in IEEE Transactions on Industrial Informatics
Cement has been widely used in civil engineering, whose quality directly affects the safety of buildings. Cement compressive strength, as an important quality indicator, its accurate estimation is of great significance in quality inspections and the design of high-performance products. However, existing measurement technology remains traditional and destructive. Except for high time-consuming and the waste of various resources, it requires significant improvement since the unprofessional operations will give rise to large errors. In this article, an efficient system is proposed to estimate the cement compressive strength based on the broad learning and internal factors, in which the index system describes the internal factors affecting the compressive strength, and the broad learning system distills the potential correlation between the compressive strength and those factors. It can nondestructively estimate the strength directly with the internal factors, e.g., clinker composition and physical properties. In addition, to verify its practicability and to assist the formula optimization in the application, the robustness test and factorial analysis are designed. The experimental results prove that this model can accurately estimate the strength with excellent generalization ability, which saves labor power and material, avoids large errors caused by unprofessional operations, and aids high-performance cement production. Especially, its ability to rapidly build an accurate estimation model is beneficial for the production of various cement in industry.
17 May 2024 in IEEE Transactions on Neural Networks and Learning Systems
Due to its marvelous performance and remarkable scalability, a broad learning system (BLS) has aroused a wide range of attention. However, its incremental learning suffers from low accuracy and long training time, especially when dealing with unstable data streams, making it difficult to apply in real-world scenarios. To overcome these issues and enrich its relevant research, a robust incremental BLS (RI-BLS) is proposed. In this method, the proposed weight update strategy introduces two memory matrices to store the learned information, thus the computational procedure of ridge regression is decomposed, resulting in precomputed ridge regression. During incremental learning, RI-BLS updates two memory matrices and renews weights via precomputed ridge regression efficiently. In addition, this update strategy is theoretically analyzed in error, time complexity, and space complexity compared with existing incremental BLSs. Different from Greville’s method used in the original incremental BLS, its results are closer to the solution of one-shot calculation. Compared with the existing incremental BLSs, the proposed method exhibits more stable time complexity and superior space complexity. The experiments prove that RI-BLS outperforms other incremental BLSs when handling both stable and unstable data streams. Furthermore, experiments demonstrate that the proposed weight update strategy applies to other random neural networks as well.