Emotions play a crucial role in human thoughts, cognitive processes, and decision-making. EEG has become a widely utilized tool in emotion recognition due to its high temporal resolution, real-time monitoring capabilities, portability, and cost-effectiveness. In this paper, we propose a novel end-to-end emotion recognition method from EEG signals, called MSDCGTNet, which is based on the Multi-Scale Dynamic 1D CNN and the Gated Transformer. First, the Multi-Scale Dynamic CNN is used to extract complex spatial and spectral features from raw EEG signals, which not only avoids information loss but also reduces computational costs associated with the time-frequency conversion of signals. Then, the Gated Transformer Encoder is utilized to capture global dependencies of EEG signals. This encoder focuses on specific regions of the input sequence while reducing computational resources through parallel processing with the improved multi-head self-attention mechanisms. Third, the Temporal Convolution Network is used to extract temporal features from the EEG signals. Finally, the extracted abstract features are fed into a classification module for emotion recognition. The proposed method was evaluated on three publicly available datasets: DEAP, SEED, and SEED_IV. Experimental results demonstrate the high accuracy and efficiency of the proposed method for emotion recognition. This approach proves to be robust and suitable for various practical applications. By addressing challenges posed by existing methods, the proposed method provides a valuable and effective solution for the field of Brain-Computer Interface (BCI).
The dramatic increase in the amount of garbage and complex diversity of the materials in the garbage bring serious environmental pollution problems and wastes resources. Recycling reduces waste but manual pipeline waste sorting involves a harsh working environment at high labor intensity with low sorting efficiency. In our paper, a novel intelligent garbage classification system based on deep learning and an embedded Linux system is proposed. The system is divided into three parts. First, a Raspberry Pi 4B is utilized as the master board for the hardware system. The peripherals of the system consist of a touch panel, sensors, a 2-DOF (degree of freedom) servo, and a camera. Second, a new GNet model for garbage classification based on transfer learning and the improved MobileNetV3 model is proposed. Third, a GUI based on Python and QT is employed to build a human-computer interaction system to facilitate system manipulation and observation. A series of garbage classification experiments on the Huawei Garbage Classification Challenge Cup dataset were conducted. The proposed classification system’s prediction accuracy was 92.62% at 0.63 s efficiency. The experimental results in this paper demonstrate that the proposed intelligent garbage classification system delivers high performance both in terms of accuracy and efficiency.
The detection of damaged building regions is crucial to emergency response actions and rescue work after a disaster. Change detection methods using multi-temporal remote sensing images are widely used for this purpose. Differing from traditional methods based on change detection for damaged building regions, semantic scene change can provide a new point of view since it can indicate the land-use variation at the semantic level. In this paper, a novel method is proposed for detecting damaged building regions based on semantic scene change in a visual Bag-of-Words model. Pre- and post-disaster scene change in building regions are represented by a uniform visual codebook frequency. The scene change of damaged and non-damaged building regions is discriminated using the Support Vector Machine (SVM) classifier. An evaluation of experimental results, for a selected study site of the Longtou hill town of Yunnan, China, which was heavily damaged in the Ludian earthquake of 14 March 2013, shows that this method is feasible and effective for detecting damaged building regions. For the experiments, WorldView-2 optical imagery and aerial imagery is used.
21 April 2023 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Detecting the damaged building regions is vital to humanitarian assistance and disaster recovery after a disaster. Deep-learning-techniques based on aerial and Unmanned Aerial Vehicle (UAV) images have been extensively applied in the literature to detect damaged building regions, which are approved to be effective methods for fast response actions and rescue work. However, most of the existing building damaged region detection methods only consider the extraction accuracy of damaged regions from aerial or UAV images, which are not real-time and can hardly meet the practical application of emergency response. To address this problem, a new real-time building damaged region detection based on improved YOLOv5 and adapted to an embedded system from UAV images is proposed, which is named as DB-YOLOv5. First, residual dilated convolution module(Res-DConv) is employed to extract the spatial features, which can increase the receptive field. Then, a feature fusion module(BDSCAM) is designed to enhance the expressive ability of object feature, which could improve the classification performance of detector. Finally, a Double-Head method, an integration system of fully connected and convolution head for bounding box regression and classification, executes the localization task. The proposed DB-YOLOv5 method was evaluated using post-disaster UAV images collected over Ludian, China in 2013 and Beichuan, China in 2008. We found that the experimental results demonstrate that the proposed method is high accuracy and efficient for building damaged region detection and assessment on the embedded system. This approach is robust and suitable for practical application in disaster scenarios.
In the process of object-based change detection (OBCD), scale is a significant factor related to extraction and analyses of subsequent change data. To address this problem, this paper describes an object-based approach to urban area change detection (CD) using rotation forest (RoF) and coarse-to-fine uncertainty analyses of multi-temporal high-resolution remote sensing images. First, highly homogeneous objects with consistent spatial positions are identified through vector-raster integration and multi-scale fine segmentation. The multi-temporal images are stacked and segmented under the constraints of a historical land use vector map using a series of optimal segmentation scales, ranging from coarse to fine. Second, neighborhood correlation image analyses are performed to highlight pixels with high probabilities of being changed or unchanged, which can be used as a prerequisite for object-based analyses. Third, based on the coarse-to-fine segmentation and pixel-based pre-classification results, change possibilities are calculated for various objects. Furthermore, changed and unchanged objects identified at different scales are automatically selected to serve as training samples. The spectral and texture features of each object are extracted. Finally, uncertain objects are classified using the RoF classifier. Multi-scale classification results are combined using a majority voting rule to generate the final CD results. In experiments using two pairs of real high-resolution remote sensing datasets, our proposed approach outperformed existing methods in terms of CD accuracy, verifying its feasibility and effectiveness.
Road is one of important traffic lifelines that could be damaged after disaster by landslide rubble, buildings debris, and collapsed branches of trees. Therefore, road damage detection and assessment using post-Disaster High-Resolution Remote Sensing Images is extremely important for finding optimal paths and conducting rescue missions. In an emergency context, the existing methods based on change detection for road damage detection are difficult to achieve due to the mismatch of different data sources, especially for rural areas where the pre-disaster remote sensing imagery are hard to obtain. In this paper, a novel method based on the Tracking, Learning, and Detector (TLD) framework for detecting the damaged road region from post-disaster high-resolution remote sensing image is presented. First, a spoke wheel operator is employed to define the initial template of road. Then, the TLD framework is used to identify the suspected road damaged areas. Finally, the damaged road areas are extracted by pruning the false damaged roads. The proposed method was evaluated using post-disaster high-resolution remote sensing images collected over Beichuan, China in 2008 and Lushan, China in 2013. The results show that the proposed method is feasible and effective for road damage detection and assessment. Our main conclusion is that such an approach qualifies for practical use.