Hyperspectral image classification (HSIC) has attracted widespread attention due to its important application in environment alterations and geophysical disaster monitoring. However, surface cultivation is not static as time passes, which leads to different hyperspectral images information collected from the same area at different time periods. Therefore, researchers are currently eager to construct a HSIC model that continuously acquires new classes of data. During the continuous learning process, the model is expected to not only effective in extracting unique spatial-spectral features of the hyperspectral image, but also ensures the ability to maintain the old classes knowledge while learning new data. To achieve this purpose, we propose a method which based on geometric spatial-spectral feature integration network with class incremental learning (GS2FIN-CIL) framework in continuous learning to make the model adaptable to new classes data and not overly forgetting the old classes knowledge during the training process. We conduct extensive experiments with the proposed GS2FIN-CIL method on widely-used hyperspectral datasets including Indian Pines, PaviaU and Salinas. The experimental results show that our GS2FIN-CIL method can achieve significantly improved results compared to current state-of-the-art class incremental learning methods, allowing for efficient adaptation and utilization of spatial-spectral features in processing new classes of hyperspectral images and alleviating the problem of catastrophic forgetting of learned old classes knowledge. The GS2FIN-CIL method could be successfully applied to the challenge of adding new classes data in HSIC task.
20 January 2022 in Physica A: Statistical Mechanics and its Applications
Trajectory recovery aims to restore missing data for reconstructing high-quality human mobility trajectory, which benefits a wide range of intelligent transportation system applications ranging from urban planning to travel recommendation. Inspired by the inherent regularity of human mobility, existing approaches capture spatial-temporal transition regularities in historical trajectory for data recovery. Although promising, existing solutions suffer from two limitations. i) These methods fail to recover occasionally-visited points (OVP) due to the lack of semantic information when learning spatial-temporal transition regularities. ii) The information before and after missing data is not be fully utilized for trajectory recovery. To overcome the limitations, we propose a novel semantic-aware trajectory recovery framework. First, we leverage heterogeneous information network (HIN) to encode various semantic correlations for obtaining rich semantic embeddings, which are fused with temporal information to form spatial-temporal semantic context. Then, we develop a behavior attention mechanism to capture semantic behavior transition regularities for trajectory recovery based on the bidirectional spatial-temporal semantic context before and after missing data. Extensive experiments on four real-world datasets show that our proposed method outperforms the state-of-the-arts by 7%-11% in term of recall, F1-score and mean average precision.
13 June 2024 in IEEE Transactions on Information Forensics and Security
The electromagnetic environments have become more complex with the development of wireless communication technology. Signal modulation classification has attracted extensive attention due to its application in electronic countermeasures and physical layer security threat prevention under complex electromagnetic environments. Excellent classification performance requirements challenge the adaptability of the method and the ability to extract modulation characteristics. This paper proposes an automated machine learning framework, AutoSMC, for signal modulation classification. An adaptive signal augmentation method is proposed to adapt to the network changes during the search process. In order to extract the modulation features effectively, an scalable convolutional random fourier feature block is proposed. Moreover, the initial search space of the framework is given. The Bayesian Optimization is used to drive hyperparameter optimization to achieve AutoSMC and obtain the optimal method state. Great experiments were carried out on RADIOML 2016.10A and RADIOML 2016.10B. Experimental evaluations on these datasets show that our approach AutoSMC achieves state-of-the-art results compared to the most relevant signal modulation classification methods.
Wind turbines are predominantly situated in remote, high-altitude regions, where they face a myriad of harsh environmental conditions. Factors such as high humidity, strong gusts, lightning strikes, and heavy snowfall significantly increase the vulnerability of turbine blades to fatigue damage. This susceptibility poses serious risks to the normal operation and longevity of the turbines, necessitating effective monitoring and maintenance strategies. In response to these challenges, this paper proposes a novel fault detection method specifically designed for analyzing wind turbine blade noise signals. This method integrates the Tyrannosaurus Optimization Algorithm (TROA) with a support vector machine (SVM), aiming to enhance the accuracy and reliability of fault detection. The process begins with the careful preprocessing of raw noise signals collected from wind turbines during actual operational conditions. The method extracts vital features from three key perspectives: the time domain, frequency domain, and cepstral domain. By constructing a comprehensive feature matrix that encapsulates multi-dimensional characteristics, the approach ensures that all relevant information is captured. Rigorous analysis and feature selection are subsequently conducted to eliminate redundant data, thereby focusing on retaining the most significant features for classification. A TROA-SVM classification model is then developed to effectively identify the faults of the turbine blades. The performance of this method is validated through extensive experiments, which indicate that the recognition accuracy rate is 98.7%. This accuracy is higher than that of the traditional methods, such as SVM, K-Nearest Neighbors (KNN), and random forest, demonstrating the proposed method’s superiority and effectiveness.
13 February 2025 in IEEE Transactions on Mobile Computing
Due to the presence of redundancy and interference, frame sampling is a promising but challenging solution to mitigate the expensive computation of video action recognition. Although the motion prior has shown great potential for frame selection, existing motion-based strategies suffer from limitations in terms of robustness and interpretive evaluation. In this paper, we devise a robust frame sampling strategy called positive motion guided sampler (PMGSampler). It consists of two procedures, local motion capture and global motion statistics. At the local level, we propose two concepts about inter-frame motion amplitude and motion continuity, which helps to perceive the movement of subjects and identify abnormal events that may generate negative pseudo-motion information. Then, through a global analysis of the obtained local motions, the sampler becomes more sensitive to informative frames and robust to outliers. The proposed sampler can be applied to most existing models for improving recognition accuracy. We conduct extensive experiments on four widely-used benchmarks to demonstrate the superiority of our PMGSampler over other methods of the same type. In addition, to analyse how sampled frames influence action recognition, we present a visual interpretation method for video models, termed as spatio-temporal class activation map (STCAM). By introducing spatial and temporal branches, our STCAM is able to visualise the salience of spatio-temporal features. With the help of STCAM, we can further intuitively evaluate the performance of different sampling strategies.