Lei Sun

Dr. Lei Sun


Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 May 2022 in Electronics
Verified
Journal Article
Open access
PDF file
YYYu Yang
Yu Yang
LSLei Sun
Lei Sun
XMXiuqing Mao
Xiuqing Mao
MZmin zhao
min zhao
Some downstream tasks often require enough data for training in deep learning, but it is formidable to acquire data in some particular fields. Generative Adversarial Network has been extensively used in data augmentation. However, it still has problems of unstable training and low quality of generated images. This paper proposed Data Augmentation Based on Generative Adversarial Network with Mixed Attention Mechanism (MA-GAN) to solve those problems. This method can generate consistent objects or scenes by correlating the remote features in the image, thus improving the ability to create details. Firstly, the channel-attention and the self-attention mechanism are added into the generator and discriminator. Then, the spectral normalization is introduced into the generator and discriminator so that the parameter matrix satisfies the Lipschitz constraint, thus improving the stability of the model training process. By qualitative and quantitative evaluations on small-scale benchmarks (CelebA, MNIST, and CIFAR-10), the experimental results show that the proposed method performs better than other methods. Compared with WGAN-GP (Improved Training of Wasserstein GANs) and SAGAN (Self-Attention Generative Adversarial Networks), the proposed method contributes to higher classification accuracy, indicating that this method can effectively augment the data of small samples.

2 November 2024 in Electronics
Verified
Journal Article
Open access
PDF file
HYHu Yudie
Hu Yudie
LSLei Sun
Lei Sun
XMXiuqing Mao
Xiuqing Mao
SZShuai Zhang
Shuai Zhang
Traditional identity recognition methods are facing significant security challenges due to their vulnerability to leakage and forgery. Brainprint recognition, a novel biometric identification technology leveraging EEG signals, has emerged as a promising alternative owing to its advantages such as resistance to coercion, non-forgeability, and revocability. Nevertheless, the scarcity of high-quality electroencephalogram (EEG) data limits the performance of brainprint recognition systems, necessitating the use of shallow models that may not perform optimally in real-world scenarios. Data augmentation has been demonstrated as an effective solution to address this issue. However, EEG data encompass diverse features, including temporal, frequency, and spatial components, posing a crucial challenge in preserving these features during augmentation. This paper proposes an end-to-end EEG data augmentation method based on a spatial–temporal generative adversarial network (STGAN) framework. Within the discriminator, a temporal feature encoder and a spatial feature encoder were parallelly devised. These encoders effectively captured global dependencies across channels and time of EEG data, respectively, leveraging a self-attention mechanism. This approach enhances the data generation capabilities of the GAN, thereby improving the quality and diversity of the augmented EEG data. The identity recognition experiments were conducted on the BCI-IV2A dataset, and Fréchet inception distance (FID) was employed to evaluate data quality. The proposed method was validated across three deep learning models: EEGNET, ShallowConvNet, and DeepConvNet. Experimental results indicated that data generated by STGAN outperform DCGAN and RGAN in terms of data quality, and the identity recognition accuracies on the three networks were improved by 2.49%, 2.59% and 1.14%, respectively.

4 November 2024 in EURASIP Journal on Advances in Signal Processing
Verified
Journal Article
Open access
PDF file
SZShuai Zhang
Shuai Zhang
LSLei Sun
Lei Sun
XMXiuqing Mao
Xiuqing Mao
MZMin Zhao
Min Zhao
YHYudie Hu
Yudie Hu
With the development of brain–computer interfaces in recent years, deep learning models have been widely used in EEG-based personal identification. The training of complex models requires a large amount of data, but the acquisition of EEG signals is very time-consuming and energy-consuming. EEG data augmentation can reduce the overhead of EEG data acquisition and provide the data volume required by various complex models, which is conducive to applying EEG identification in practice. The generative adversarial network (GAN) has been applied to augment EEG data features. But the augmentation of temporal EEG signals is less studied. Therefore, this paper proposes a method of temporal EEG data augmentation based on an attention mechanism time series generative adversarial network (ATGAN), which can expand the original EEG dataset to facilitate the training of downstream deep learning classifiers. The experiment is conducted on the BCI Competition IV 2a dataset. The ATGAN model is trained with the temporal EEG signals after preprocessing, and the generated augmentation data by ATGAN is used to expand the original dataset. The accuracy of the EEG-based identification task on the augmented dataset is 7.78% higher than that on the original dataset, which proves the effectiveness of the proposed method.

8 December 2023 in Electronics
Verified
Journal Article
Open access
PDF file
MZmin zhao
min zhao
SZShuai Zhang
Shuai Zhang
XMXiuqing Mao
Xiuqing Mao
LSLei Sun
Lei Sun
Electroencephalogram (EEG) signals are bioelectrical activities generated by the central nervous system. As a unique information factor, they are correlated with the genetic information of the subjects, exhibiting robustness against forgery. The development of biometric identity recognition based on EEG signals has significantly improved the security and accuracy of biometric recognition. However, EEG signals obtained from incompatible acquisition devices have low universality and are prone to noise, making them challenging for direct use in practical identity recognition scenarios. Employing deep learning network models for data augmentation can address the issue of data scarcity. Yet, the time–frequency–space characteristics of EEG signals pose challenges for extracting features and efficiently generating data with deep learning models. To tackle these challenges, this paper proposes a data generation method based on channel attention normalization and spatial pyramid in a generative adversative network (FastGAN-ASP). The method introduces attention mechanisms in both the generator and discriminator to locate crucial feature information, enhancing the training performance of the generative model for EEG data augmentation. The EEG data used here are preprocessed EEG topographic maps, effectively representing the spatial characteristics of EEG data. Experiments were conducted using the BCI Competition IV-Ⅰ and BCI Competition IV-2b standard datasets. Quantitative and usability evaluations were performed using the Fréchet inception distance (FID) metric and ResNet-18 classification network, validating the quality and usability of the generated data from both theoretical and applied perspectives. The FID metric confirmed that FastGAN-ASP outperforms FastGAN, WGAN-GP, and WGAN-GP-ASP in terms of performance. Moreover, utilizing the dataset augmented with this method for classification recognition achieved an accuracy of 95.47% and 92.43%.

14 July 2023 in Electronics
Verified
Journal Article
Open access
PDF file
LSLei Sun
Lei Sun
WXWang xiaoqin
Wang xiaoqin
YYYouhuan Yang
Youhuan Yang
XMXiuqing Mao
Xiuqing Mao
With the rapid development of adversarial example technologies, the concept of adversarial patches has been proposed, which can successfully transfer adversarial attacks to the real world and fool intelligent object detection systems. However, the real-world environment is complex and changeable, and the adversarial patch attack technology is susceptible to real-world factors, resulting in a decrease in the success rate of attack. Existing adversarial-patch-generation algorithms have a single direction of patch initialization and do not fully consider the impact of initial diversification on its upper limit of adversarial patch attack. Therefore, this paper proposes an initial diversified adversarial patch generation technology to improve the effect of adversarial patch attacks on the underlying algorithms in the real world. The method uses YOLOv4 as the attack model, and the experimental results show that the attack effect of the adversarial-patch-attack method proposed in this paper is higher than the baseline 8.46%, and it also has a stronger attack effect and fewer training rounds.

1 January 2024 in Computers, Materials & Continua
Verified
Journal Article
Open access
PDF file
ZDZhiyi Ding
Zhiyi Ding
LSLei Sun
Lei Sun
XMXiuqing Mao
Xiuqing Mao
LDLeyu Dai
Leyu Dai
RDRuiyang Ding
Ruiyang Ding
Object detection finds wide application in various sectors, including autonomous driving, industry, and healthcare. Recent studies have highlighted the vulnerability of object detection models built using deep neural networks when confronted with carefully crafted adversarial examples. This not only reveals their shortcomings in defending against malicious attacks but also raises widespread concerns about the security of existing systems. Most existing adversarial attack strategies focus primarily on image classification problems, failing to fully exploit the unique characteristics of object detection models, thus resulting in widespread deficiencies in their transferability. Furthermore, previous research has predominantly concentrated on the transferability issues of non-targeted attacks, whereas enhancing the transferability of targeted adversarial examples presents even greater challenges. Traditional attack techniques typically employ cross-entropy as a loss measure, iteratively adjusting adversarial examples to match target categories. However, their inherent limitations restrict their broad applicability and transferability across different models. To address the aforementioned challenges, this study proposes a novel targeted adversarial attack method aimed at enhancing the transferability of adversarial samples across object detection models. Within the framework of iterative attacks, we devise a new objective function designed to mitigate consistency issues arising from cumulative noise and to enhance the separation between target and non-target categories (logit margin). Secondly, a data augmentation framework incorporating random erasing and color transformations is introduced into targeted adversarial attacks. This enhances the diversity of gradients, preventing overfitting to white-box models. Lastly, perturbations are applied only within the specified object’s bounding box to reduce the perturbation range, enhancing attack stealthiness. Experiments were conducted on the Microsoft Common Objects in Context (MS COCO) dataset using You Only Look Once version 3 (YOLOv3), You Only Look Once version 8 (YOLOv8), Faster Region-based Convolutional Neural Networks (Faster R-CNN), and RetinaNet. The results demonstrate a significant advantage of the proposed method in black-box settings. Among these, the success rate of RetinaNet transfer attacks reached a maximum of 82.59%.