Insulator defect detection is of great significance to ensure the normal operation of power transmission and distribution networks. In response to the problems of low speed, low accuracy, and difficulty in deploying to embedded terminals in existing insulator defect detection, this paper proposes a lightweight insulator defect detection model based on an improved YOLOv5s, named LiteYOLO-ID. Firstly, to significantly reduce the model parameters while maintaining detection accuracy, we design a new lightweight convolution module called EGC (ECA-GhostNet-C2f). Secondly, based on the EGC module, we construct the EGC-CSPGhostNet backbone network, which optimizes the feature extraction process and achieves model compression. Additionally, we design a lightweight neck network, EGC-PANet, to further reduce the parameter count and achieve efficient feature fusion. Experimental results show that on the IDID-Plus dataset, compared to the original YOLOv5s model, not only does LiteYOLO-ID reduce the model parameters by 47.13%, but it also improves the mAP(0.5) by 1%. Furthermore, the generalization of the model is validated on the Pascal VOC dataset and the SFID dataset. Importantly, after TensorRT optimization, the inference speed of the LiteYOLO-ID algorithm on the Jetson TX2 NX reaches 20.2 FPS, meeting the real-time detection requirements of insulator defects. Our code, weight models, and datasets can be obtained at the following URL: https://github.com/LuYang-2023/Insulator-defect-detection.

Emotion analysis has been employed in many fields such as human-computer interaction, rehabilitation, and neuroscience. But most emotion analysis methods mainly focus on healthy controls or depression patients. This paper aims to classify the emotional expressions in individuals with hearing impairment based on EEG signals and facial expressions. Two kinds of signals were collected simultaneously when the subjects watched affective video clips, and we labeled the video clips with discrete emotional states (fear, happiness, calmness, and sadness). We extracted the differential entropy (DE) features based on EEG signals and converted DE features into EEG topographic maps (ETM). Next, the ETM and facial expressions were fused by the multichannel fusion method. Finally, a deep learning classifier CBAM_ResNet34 combined Residual Network (ResNet) and Convolutional Block Attention Module (CBAM) was used for subject-dependent emotion classification. The results show that the average classification accuracy of four emotions recognition after multimodal fusion achieves 78.32%, which is higher than 67.90% for facial expressions and 69.43% for EEG signals. Moreover, visualization by the Gradient-weighted Class Activation Mapping (Grad-CAM) of ETM showed that the prefrontal, temporal and occipital lobes were the brain regions closely related to emotional changes in individuals with hearing impairment.

Recent research on emotion recognition suggests that deep network-based adversarial learning has an ability to solve the cross-subject problem of emotion recognition. This study constructed a hearing-impaired electroencephalography (EEG) emotion dataset containing three emotions (positive, neutral, and negative) in 15 subjects. The emotional domain adversarial neural network (EDANN) was carried out to identify hearing-impaired subjects' emotions by learning hidden emotion information between the labeled data and the data with no-label. For the input data, we propose a spatial filter matrix to reduce the overfitting of the training data. A feature extraction network 3DLSTM-ConvNET was used to extract comprehensive emotional information from the time, frequency, and spatial dimensions. Moreover, emotion local domain discriminator and emotion film group local domain discriminator were added to reduce the distribution distance between the same kinds of emotions and different film groups, respectively. According to the experimental results, the average accuracy of subject-dependent is 0.984 (STD: 0.011), and that of subject-independent is 0.679 (STD: 0.140). In addition, by analyzing the discrimination characteristics, we found that the brain regions with emotional recognition in the hearing-impaired are distributed in the wider areas of the parietal and occipital lobes, which may be caused by visual processing.

Emotion recognition based on electroencephalogram (EEG) signals has been one of the most active research topics of affective computing. In previous studies of emotion recognition, the selection of stimulus sources was usually focused on single stimuli, such as visual or auditory. In this work, we propose a novel emotional stimulation scheme that synchronizes haptic vibration with audiovisual content to form a mixed sense of visual–auditory–haptic to trigger emotions. Fifteen subjects were recruited to watch the four kinds of emotional movie clips (happiness, fear, sadness, and neutral) with haptic or not, and their EEG signals were collected simultaneously. The power spectral density (PSD) feature, differential entropy (DE) feature, wavelet entropy (WE) feature, and brain function network (BFN) feature were extracted and fused to reflect the time–frequency–spatial domain of emotional EEG signals. The t-distributed stochastic neighbor embedding (t-SNE) was utilized for dimensionality reduction and feature selection. In addition, the fusion features are classified by the stacking ensemble learning framework. The experimental results show that the proposed haptic vibration strategy can enhance the activity of emotion-related brain regions, and the average classification accuracy was 85.46%.

In recent years, many researchers have explored different methods to obtain discriminative features for electroencephalogram-based (EEG-based) emotion recognition, but a few studies have been investigated on deaf subjects. In this study, we have established a deaf EEG emotion dataset, which contains three kinds of emotion (positive, neutral, and negative) with 15 subjects. Ten kinds of time–frequency domain features and eleven kinds of nonlinear dynamic system features were extracted from the EEG signals. To obtain the optimal feature combination and optimal classifier, an integrated genetic firefly algorithm (IGFA) was proposed. The multi-objective function with variable weight was utilized to balance the classification accuracy and the feature reduction ratio that are contradictory goals to find brighter fireflies in each generation. To retain the historical optimal solution and reduce the feature dimension, an optimal population protection scheme and subgroups generation scheme was carried out. The experimental results show that the averaged feature reduction rate of the proposed method is 0.959, and the averaged classification accuracy is 0.961. By investigating important brain regions, deaf subjects have common areas in the frontal and temporal lobes for EEG emotion recognition, while individual areas occur in the occipital and parietal lobes.