shen Mr. guo

Mr. shen Mr. guo


Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 June 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
JLJiajun Liu
Jiajun Liu
AWAishan Wumaier
Aishan Wumaier
DWDongPing Wei
DongPing Wei
SGshen Mr. guo
shen Mr. guo
Speech is critical for interpersonal communication, but not everyone has fluent communication skills. Speech disfluency, including stuttering and interruptions, affects not only emotional expression but also clarity of expression for people who stutter. Existing methods for detecting speech disfluency rely heavily on annotated data, which can be costly. Additionally, these methods have not considered the issue of variable-length disfluent speech, which limits the scalability of detection methods. To address these limitations, this paper proposes an automated method for detecting speech disfluency that can improve communication skills for individuals and assist therapists in tracking the progress of stuttering patients. The proposed method focuses on detecting four types of disfluency features using single-task detection and utilizes embeddings from the pre-trained wav2vec2.0 model, as well as convolutional neural network (CNN) and Transformer models for feature extraction. The model’s scalability is improved by considering the issue of variable-length disfluent speech and modifying the model based on the entropy invariance of attention mechanisms. The proposed automated method for detecting speech disfluency has the potential to assist individuals in overcoming speech disfluency, improve their communication skills, and aid therapists in tracking the progress of stuttering patients. Additionally, the model’s scalability across languages and lengths enhances its practical applicability. The experiments demonstrate that the model outperforms baseline models in both English and Chinese datasets, proving its universality and scalability in real-world applications.

9 April 2023 in Electronics
Verified
Journal Article
Open access
PDF file
JLJiajun Liu
Jiajun Liu
AWAishan Wumaier
Aishan Wumaier
CFCong Fan
Cong Fan
SGshen Mr. guo
shen Mr. guo
The automatic fluency assessment of spontaneous speech without reference text is a challenging task that heavily depends on the accuracy of automatic speech recognition (ASR). Considering this scenario, it is necessary to explore an assessment method that combines ASR. This is mainly due to the fact that in addition to acoustic features being essential for assessment, the text features output by ASR may also contain potentially fluency information. However, most existing studies on automatic fluency assessment of spontaneous speech are based solely on audio features, without utilizing textual information, which may lead to a limited understanding of fluency features. To address this, we propose a multimodal automatic speech fluency assessment method that combines ASR output. Specifically, we first explore the relevance of the fluency assessment task to the ASR task and fine-tune the Wav2Vec2.0 model using multi-task learning to jointly optimize the ASR task and fluency assessment task, resulting in both the fluency assessment results and the ASR output. Then, the text features and audio features obtained from the fine-tuned model are fed into the multimodal fluency assessment model, using attention mechanisms to obtain more reliable assessment results. Finally, experiments on the PSCPSF and Speechocean762 dataset suggest that our proposed method performs well in different assessment scenarios.

18 June 2025 in Measurement
Verified
Journal Article
Closed access
SGshen Mr. guo
shen Mr. guo
YLYing Li
Ying Li
JSJiashuo Shang
Jiashuo Shang
LCLingxiao Cheng
Lingxiao Cheng

22 May 2023 in IEEE Access
Verified
Journal Article
Open access
SGshen Mr. guo
shen Mr. guo
ZKZaokere Kadeer
Zaokere Kadeer
AWAishan Wumaier
Aishan Wumaier
LWLiejun Wang
Liejun Wang
CFCong Fan
Cong Fan
In recent years, with the development of deep learning, research on end-to-end mispronunciation detection and diagnosis(MDD) methods has been further promoted. At present, research on end-to-end mispronunciation detection and diagnosis is gradually emerging. Most end-to-end mispronunciation detection and diagnosis methods are based on the CNN-RNN-CTC network structure. To improve the performance of end-to-end mispronunciation detection and diagnosis systems, this paper proposes an end-to-end multi-feature and multi-modal mispronunciation detection and diagnosis method based on the Squeezeformer encoder. The model uses Squeezeformer as an audio encoder, a Bi-LSTM network as a phoneme encoder, and Transformer as a decoder. The model fuses phoneme information before speech encoding and decoding, respectively, and uses a secondary decoding mechanism during the decoding process. This study further incorporated phoneme information in the encoding process so that the model could learn the intrinsic characteristics of the speaker’s pronunciation content. The decoding process uses a secondary decoding mechanism to send the sequence decoded by the model to the decoder for decoding again, which solves the problem of no a priori knowledge at the decoder end in the first decoding stage, thus improving the performance of mispronunciation detection and diagnosis. In this study, experiments were conducted on the PSC-Reading Mandarin mispronunciation detection and diagnosis dataset. Compared with the baseline model, the F1 index improved from 0.4060 to 0.7943, and the diagnostic accuracy improved from 83.93% to 88.45%.

9 January 2026 in Expert Systems with Applications
Verified
Journal Article
Closed access
JSJiashuo Shang
Jiashuo Shang
YLYing Li
Ying Li
JYJingyi Yuan
Jingyi Yuan
SGshen Mr. guo
shen Mr. guo

29 December 2025 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
SGshen Mr. guo
shen Mr. guo
YLYing Li
Ying Li
JSJiashuo Shang
Jiashuo Shang
ZWZi Wang
Zi Wang
JYJingyi Yuan
Jingyi Yuan
With the increasing frequency of port trade activities, oil spill incidents pose severe threats to marine ecosystems. The complex port environments, characterized by diverse land cover types and intricate land-water interfaces, present significant challenges for oil spill detection (OSD). To address this, we propose a parameter-efficient fine-tuning (PEFT) approach based on the segment anything model (SAM) for port OSD tasks utilizing unmanned aerial vehicle (UAV) remote sensing imagery. The proposed DADS-SAM freezes most parameters of SAM and performs PEFT only on adapters. Dynamic adaptive low-rank adaptation (DALoRA) enhances the model’s adaptability to port OSD tasks by incorporating dynamic adaptive low-rank matrices into the self-attention modules of the SAM encoder, while dual scale convolutional adapter (DSCA) improves the model’s capability to capture local features and spatial dependencies in oil spill regions. Since the original SAM model lacks class-specific segmentation capabilities, we further design a multi-class segmentation head (MCSH) for oil spill segmentation. This head obtains the output masks from the SAM decoder, adjusts their dimensions, and transforms them through two linear layers to generate class-specific segmentation results. To the best of our knowledge, this study is the first to apply a PEFT approach to port OSD tasks. The proposed method was evaluated on both publicly available port oil-spill datasets and marine oil-spill datasets acquired via synthetic-aperture radar (SAR). Quantitative comparisons demonstrate that DADS-SAM outperforms conventional approaches and achieves state-of-the-art performance across all evaluated metrics. Models and data are publicly available at https://github.com/PetrichorAsh/DADS-SAM.