Shaoyun Xu

Dr. Shaoyun Xu

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 May 2021 in Sensors
Verified
Journal Article
Open access
PDF file
HDHuaBin Diao
HuaBin Diao
YHYuexing Hao
Yuexing Hao
SXShaoyun Xu
Shaoyun Xu
GLGongyan Li
Gongyan Li
Convolutional neural networks (CNNs) have achieved significant breakthroughs in various domains, such as natural language processing (NLP), and computer vision. However, performance improvement is often accompanied by large model size and computation costs, which make it not suitable for resource-constrained devices. Consequently, there is an urgent need to compress CNNs, so as to reduce model size and computation costs. This paper proposes a layer-wise differentiable compression (LWDC) algorithm for compressing CNNs structurally. A differentiable selection operator OS is embedded in the model to compress and train the model simultaneously by gradient descent in one go. Instead of pruning parameters from redundant operators by contrast to most of the existing methods, our method replaces the original bulky operators with more lightweight ones directly, which only needs to specify the set of lightweight operators and the regularization factor in advance, rather than the compression rate for each layer. The compressed model produced by our method is generic and does not need any special hardware/software support. Experimental results on CIFAR-10, CIFAR-100 and ImageNet have demonstrated the effectiveness of our method. LWDC obtains more significant compression than state-of-the-art methods in most cases, while having lower performance degradation. The impact of lightweight operators and regularization factor on the compression rate and accuracy also is evaluated.

7 August 2024 in Expert Systems with Applications
Verified
Journal Article
Closed access
CSChaokun Shi
Chaokun Shi
YHYuexing Hao
Yuexing Hao
GLGongyan Li
Gongyan Li
SXShaoyun Xu
Shaoyun Xu

10 April 2023 in Neural Computing and Applications
Verified
Journal Article
Closed access
PDF file
MLMeiling Lin
Meiling Lin
GLGongyan Li
Gongyan Li
YHYuexing Hao
Yuexing Hao
SXShaoyun Xu
Shaoyun Xu

24 October 2020 in Machine Vision and Applications
Verified
Journal Article
Closed access
PDF file
XSXiaoye Sun
Xiaoye Sun
GLGongyan Li
Gongyan Li
SXShaoyun Xu
Shaoyun Xu

2 March 2025
Verified
Book Chapter
Closed access
PDF file
YSYuhui Sun
Yuhui Sun
SXShaoyun Xu
Shaoyun Xu
YWYang Wang
Yang Wang
SZShu Zhang
Shu Zhang
YHYuexing Hao
Yuexing Hao

26 March 2020 in arXiv
Verified
Preprint
Open access
PDF file
XSXiaoye Sun
Xiaoye Sun
GLGongyan Li
Gongyan Li
SXShaoyun Xu
Shaoyun Xu
Deep learning achieves excellent performance in many domains, so we not only apply it to the navel orange semantic segmentation task to solve the two problems of distinguishing defect categories and identifying the stem end and blossom end, but also propose a fastidious attention mechanism to further improve model performance. This lightweight attention mechanism includes two learnable parameters, activations and thresholds, to capture long-range dependence. Specifically, the threshold picks out part of the spatial feature map and the activation excite this area. Based on activations and thresholds training from different types of feature maps, we design fastidious self-attention module (FSAM) and fastidious inter-attention module (FIAM). And then construct the Fastidious Attention Network (FANet), which uses U-Net as the backbone and embeds these two modules, to solve the problems with semantic segmentation for stem end, blossom end, flaw and ulcer. Compared with some state-of-the-art deep-learning-based networks under our navel orange dataset, experiments show that our network is the best performance with pixel accuracy 99.105%, mean accuracy 77.468%, mean IU 70.375% and frequency weighted IU 98.335%. And embedded modules show better discrimination of 5 categories including background, especially the IU of flaw is increased by 3.165%.