Yonggu Wang

Prof. Dr. Yonggu Wang

orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 March 2025 in Applied Sciences
Verified
Journal Article
Open access
PDF file
YWYonggu Wang
Yonggu Wang
KPKailin Pan
Kailin Pan
YSYifan Shao
Yifan Shao
JMJiarong Ma
Jiarong Ma
XLXiaojuan Li
Xiaojuan Li
With advances in digital technology, including deep learning and big data analytics, new methods have been developed for autism diagnosis and intervention. Emotion recognition and the detection of autism in children are prominent subjects in autism research. Typically using single-modal data to analyze the emotional states of children with autism, previous research has found that the accuracy of recognition algorithms must be improved. Our study creates datasets on the facial and speech emotions of children with autism in their natural states. A convolutional vision transformer-based emotion recognition model is constructed for the two distinct datasets. The findings indicate that the model achieves accuracies of 79.12% and 83.47% for facial expression recognition and Mel spectrogram recognition, respectively. Consequently, we propose a multimodal data fusion strategy for emotion recognition and construct a feature fusion model based on an attention mechanism, which attains a recognition accuracy of 90.73%. Ultimately, by using gradient-weighted class activation mapping, a prediction heat map is produced to visualize facial expressions and speech features under four emotional states. This study offers a technical direction for the use of intelligent perception technology in the realm of special education and enriches the theory of emotional intelligence perception of children with autism.

10 November 2022 in Journal of Educational Computing Research
Verified
Journal Article
Closed access
XZXuesong Zhai
Xuesong Zhai
JXJiaqi Xu
Jiaqi Xu
Nian-Shing ChenNian-Shing Chen
Nian-Shing Chen
Jun ShenJun Shen
Jun Shen
YLYan Li
Yan Li
YZYumeng Zhu
Yumeng Zhu
Affective computing (AC) has been regarded as a relevant approach to identifying online learners’ mental states and predicting their learning performance. Previous research mainly used one single-source data set, typically learners’ facial expression, to compute learners’ affection. However, a single facial expression may represent different affections in various head poses. This study proposed a dual-source data approach to solve the problem. Facial expression and head pose are two typical data sources that can be captured from online learning videos. The current study collected a dual-source data set of facial expressions and head poses from an online learning class in a middle school. A deep learning neural network using AlexNet with an attention mechanism was developed to verify the syncretic effect on affective computing of the proposed dual-source fusion strategy. The results show that the dual-source fusion approach significantly outperforms the single-source approach based on the AC recognition accuracy between the two approaches (dual-source approach using Attention-AlexNet model 80.96%; single-source approach, facial expression 76.65% and head pose 64.34%). This study contributes to the theoretical construction of the dual-source data fusion approach, and the empirical validation of the effect of the Attention-AlexNet neural network approach on affective computing in online learning contexts.

4 February 2025 in Applied Sciences
Verified
Journal Article
Open access
PDF file
YWYonggu Wang
Yonggu Wang
YSYifan Shao
Yifan Shao
ZYZengyi "Zengyi Yu"
Zengyi "Zengyi Yu"
ZWZIhan Wang
ZIhan Wang
Restricted and Repetitive Behaviors (RRBs) are hallmark features of children with autism spectrum disorder (ASD) and are also one of the diagnostic criteria for the condition. Traditional methods of RRBs assessment through manual observation are limited by low diagnostic efficiency and uncertainty in outcomes. As a result, AI-assisted screening for autism has emerged as a promising research direction. In this study, we explore the synergy of visual foundation models and multimodal large language models (MLLMs), proposing a Multi-Model Synergistic Restricted and Repetitive Behavior Recognition method (MS-RRBR). Based on this method, we developed an interpretable multi-model autonomous question-answering system. To evaluate the effectiveness of our approach, we collected and annotated the Autism Restricted and Repetitive Behavior Dataset (ARRBD), which includes 10 ASD-related behaviors easily observable from various visual perspectives. Experimental results on the ARRBD dataset demonstrate that our multi-model collaboration outperforms single-model approaches, achieving the highest recognition accuracy of 94.94%. The MS-RRBR leverages the extensive linguistic knowledge of GPT-4o to enhance the zero-shot visual recognition capabilities of the MLLM, while also providing clear explanations for system decisions. This approach holds promise for providing timely, reliable, and accurate technical support for clinical diagnosis and educational rehabilitation in ASD.

20 May 2025 in Applied Sciences
Verified
Journal Article
Open access
PDF file
YWYonggu Wang
Yonggu Wang
ZYZeyu Yu
Zeyu Yu
ZWZIhan Wang
ZIhan Wang
ZYZengyi Yu
Zengyi Yu
JWJue Wang
Jue Wang
The question generation system (QGS) for information technology (IT) education, designed to create, evaluate, and improve Multiple-Choice Questions (MCQs) using knowledge graphs (KGs) and large language models (LLMs), encounters three major needs: ensuring the generation of contextually relevant and accurate distractors, enhancing the diversity of generated questions, and balancing the higher-order thinking of questions to match various learning levels. To address these needs, we proposed a multi-agent system named Multi-Examiner, which integrates KGs, domain-specific search tools, and local knowledge bases, categorized according to Bloom’s taxonomy, to enhance the contextual relevance, diversity, and higher-order thinking of automatically generated information technology MCQs. Our methodology employed a mixed-methods approach combining system development with experimental evaluation. We first constructed a specialized architecture combining knowledge graphs with LLMs, then implemented a comparative study generating questions across six knowledge points from K-12 Computer Science Standard. We designed a multidimensional evaluation rubric to assess the semantic coherence, answer correctness, question validity, distractor relevance, question diversity, and higher-order thinking, and conducted a statistical analysis of ratings provided by 30 high school IT teachers. Results showed statistically significant improvements (p < 0.01) with Multi-Examiner outperforming GPT-4 by an average of 0.87 points (on a 5-point scale) for evaluation-level questions and 1.12 points for creation-level questions. The results demonstrated that: (i) overall, questions generated by the Multi-Examiner system outperformed those generated by GPT-4 across all dimensions and closely matched the quality of human-crafted questions in several dimensions; (ii) domain-specific search tools significantly enhanced the diversity of questions generated by Multi-Examiner; and (iii) GPT-4 generated better questions for knowledge points at the “remembering” and “understanding” levels, while Multi-Examiner significantly improved the higher-order thinking of questions for the “evaluating” and “creating” levels. This study contributes to the growing body of research on AI-supported educational assessment by demonstrating how specialized knowledge structures can enhance automated generation of higher-order thinking questions beyond what general-purpose language models can achieve.

20 February 2025 in Preprints.org
Verified
Preprint
Open access
PDF file
YWYonggu Wang
Yonggu Wang
KPKailin Pan
Kailin Pan
YSYifan Shao
Yifan Shao
JMJiarong Ma
Jiarong Ma
XLXiaojuan Li
Xiaojuan Li
With advances in digital technology, including deep learning and big data analytics, new methods have been developed for autism diagnosis and intervention. Emotion recognition and the detection of autism in children are prominent subjects in autism research. Typically using single-modal data to analyze the emotional states of children with autism, previous research has found that the accuracy of recognition algorithms must be improved. Our study creates datasets on the facial and speech emotions of children with autism in their natural states. A convolutional vision transformer-based emotion recognition model is constructed for the two distinct datasets. The findings indicate that the model achieves accuracies of 79.12% and 83.47% for facial expression recognition and Mel spectrogram recognition, respectively. Consequently, we propose a multimodal data fusion strategy for emotion recognition and construct a feature fusion model based on an attention mechanism, which attains a recognition accuracy of 90.73%. Ultimately, by using gradient-weighted class activation mapping, a prediction heat map is produced to visualize facial expressions and speech features under four emotional states. This study offers technical direction for the use of intelligent perception technology in the realm of special education and enriches the theory of emotional intelligence perception of children with autism.

14 March 2025 in Preprints.org
Verified
Preprint
Open access
PDF file
YWYonggu Wang
Yonggu Wang
ZYZeyu Yu
Zeyu Yu
ZYZengyi Yu
Zengyi Yu
ZWZIhan Wang
ZIhan Wang
JWJue Wang
Jue Wang
The Question Generation System (QGS) for Information Technology (IT) education, designed to create, evaluate, and improve Multiple-Choice Questions (MCQs) using Knowledge graphs (KGs) and Large Language Models (LLMs), encounters three major needs: ensuring the generation of contextually relevant and accurate distractors, enhancing the diversity of generated questions, and balancing the higher-order thinking of questions to match various learning levels. To address these needs, we proposed a multi-agent system named Multi-Examiner, which integrates knowledge graphs, domain-specific search tools, and local knowledge bases, categorized according to Bloom’s taxonomy, to enhance the contextual relevance, diversity, and higher-order thinking of automatically generated information technology multiple-choice questions. We designed a multidimensional evaluation rubric to assess the semantic coherence, answer correctness, question validity, distractor relevance, question diversity, and higher-order thinking, and applied it to questions generated for six knowledge points from the second chapter of the "Information Systems and Society" textbook using both the Multi-Examiner system and GPT-4, alongside real exam questions, evaluated by 30 high school IT teachers. The results demonstrated that: (i) overall, questions generated by the Multi-Examiner system outperformed those generated by GPT-4 across all dimensions and closely matched the quality of human-crafted questions in several dimensions; (ii) domain-specific search tools significantly enhanced the diversity of questions generated by Multi-Examiner; (iii) GPT-4 generated better questions for knowledge points at the "remembering" and "understanding" levels, while Multi-Examiner significantly improved the higher-order thinking of questions for "evaluating" and "creating" levels. This study highlights the potential of multi-agent systems in advancing question generation.