Yang Liu

Yang Liu

Auto-generated profile, based on publicly available information

Yang Liu

Fifth Clinical College, Guangzhou University of Chinese Medicine, Guangzhou, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 March 2024 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
JYJiayu Ye
Jiayu Ye
AZAn Zeng
An Zeng
DPDan Pan
Dan Pan
YZYiqun Zhang
Yiqun Zhang
JZJingliang Zhao
Jingliang Zhao
YLYang Liu
Yang Liu
The integration of structural magnetic resonance imaging (sMRI) and deep learning techniques is one of the important research directions for the automatic diagnosis of Alzheimer's disease (AD). Despite the satisfactory performance achieved by existing voxel-based models based on convolutional neural networks (CNNs), such models only handle AD-related brain atrophy at a single spatial scale and lack spatial localization of abnormal brain regions based on model interpretability. To address the above limitations, we propose a traceable interpretability model for AD recognition based on multi-patch attention (MAD-Former). MAD-Former consists of two parts: recognition and interpretability. In the recognition part, we design a 3D brain feature extraction network to extract local features, followed by constructing a dual-branch attention structure with different patch sizes to achieve global feature extraction, forming a multi-scale spatial feature extraction framework. Meanwhile, we propose an important attention similarity position loss function to assist in model decision-making. The interpretability part proposes a traceable method that can obtain a 3D ROI space through attention-based selection and receptive field tracing. This space encompasses key brain tissues that influence model decisions. Experimental results reveal the significant role of brain tissues such as the Fusiform Gyrus (FuG) in AD recognition. MAD-Former achieves outstanding performance in different tasks on ADNI and OASIS datasets, demonstrating reliable model interpretability.

4 November 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
JYJiayu Ye
Jiayu Ye
YYYanhong Yu
Yanhong Yu
LLLin Lu
Lin Lu
HWHao Wang
Hao Wang
YZYunshao Zheng
Yunshao Zheng
QWQingxiang Wang
Qingxiang Wang
Clinical research has demonstrated that exploring behavioral signal differences between depressed patients and non-depressed people using audiovisual technology is an effective approach for achieving depression recognition. Hence, in this paper we propose an emotion word reading experiment (EWRE), and extract features from facial expressions and audios for depression recognition. Building upon this, we propose a depression recognition model (DEP-Former), which deeply integrates multimodal features. DEP-Former first designs a modality adapter to achieve emotion space mapping and the sharing of multimodal features, addressing cross-modal inconsistencies. Simultaneously, it proposes a mechanism of attention index sharing, exceeding the limitations of cognitive subjectivity by calculating confidence in key emotional information across modalities. Finally, we propose a multimodal cross-attention module and a Bernoulli distribution feature fusion prediction module to achieve deep integration of multilevel information, thereby enabling depression recognition. Compared with existing advanced multimodal models, DEP-Former demonstrates superior performance in EWRE, achieving an accuracy of 0.9500 and an F1 score of 0.9499, significantly enhancing depression recognition over the single-modality methods. Furthermore, its robust generalization ability is validated on the AVEC 2014 dataset. Through the attention query of the interpretability analysis module, we discover that depressed patients exhibit heightened sensitivity to negative emotional words, such as dismissal and tragedy. In contrast, healthy individuals tend to be more attuned to positive emotional words, including passion, purity, and justice. Additionally, depressed patients exhibit a degree of psychological state diversity, showing sensitivity to some positive emotional words as well. Our codes and data are available at https://github.com/QLUTEmoTechCrew/DEP-Former.

19 February 2025 in IEEE Transactions on Emerging Topics in Computational Intelligence
Verified
Journal Article
Closed access
JYJiayu Ye
Jiayu Ye
DPDan Pan
Dan Pan
AZAn Zeng
An Zeng
YZYiqun Zhang
Yiqun Zhang
QCQiuping Chen
Qiuping Chen
YLYang Liu
Yang Liu
Deep learning models are widely used in medical image-guided disease recognition and have achieved outstanding performance. Voxel-based models are typically the default choice for deep learning-based MRI analysis, which require high computational resources and large data volumes, making them inefficient for rapid disease screening. Simultaneously, the existing Alzheimer's disease (AD) recognition model is primarily comprised of Convolutional Neural Network (CNN) structures. With the increasing of the network depth, the fine-grained details of global features tend to be partially lost. Therefore, we propose a Multi-scale spatial self-attention Network (MssNet) that effectively captures both coarse-grained and fine-grained features. We design to select the target slice based on image entropy to achieve efficient slice-based AD recognition. To capture multi-level spatial information, a novel spatial attention mechanism and spatial self-attention attention are designed. The former is utilized to collect critical spatial information and identify areas that are likely to be lesions, the latter investigates the relationship between features in different image regions through spatial interaction by pure convolutional blocks. MssNet fully utilizes multi-scale information at different granularities for spatial feature interaction, providing it with strong modeling and information understanding capabilities. It has achieved excellent performance in the recognition tasks of Alzheimer's Disease Neuroimaging Initiative (ADNI) and Open Access Series of Imaging Studies (OASIS) datasets. Moreover, MssNet is a lightweight model involving lower scale parameters against the Voxel-based ones, while demonstrating strong generalization capability.

27 February 2024 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
JYJiayu Ye
Jiayu Ye
YYYanhong Yu
Yanhong Yu
YZYunshao Zheng
Yunshao Zheng
YLYang Liu
Yang Liu
QWQingxiang Wang
Qingxiang Wang
Facial expressions are important nonverbal behaviors that humans use to express their feelings. Clinical research have shown that depressed patients have poor facial expressiveness and mimicry. As a result, we propose a VFEM experiment with seven expressions to explore variations in facial expression features between depressed patients and normal people, including anger, disgust, fear, happiness, neutrality, sadness, and surprise. It has been discovered through VFEM experiments that depressed patients frequently exhibit negative facial expressions. Meanwhile, we propose a depression facial expression recognition (Dep-FER) model in this research. Dep-FER involves three innovative and crucial components: Mask Multi-head Self-Attention (MMSA), facial action unit similarity loss function (AUs Loss), and case-control loss function (CC Loss). MMSA can filter out disturbing samples and force to learn the relationship between different samples. AUs Loss utilizes the similarity between each expression AU and the model output to improve the generalization ability of the model. CC Loss addresses the intrinsic link between the depressed and normal patient categories. Dep-FER achieves excellent performance in VFEM and outperforms existing comparative models.

14 May 2025 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
JYJiayu Ye
Jiayu Ye
YYYanhong Yu
Yanhong Yu
QWQingxiang Wang
Qingxiang Wang
GLGuolong Liu
Guolong Liu
WLWentao Li
Wentao Li
YZYunshao Zheng
Yunshao Zheng
Facial Expression Recognition (FER) is a critical method for evaluating the emotional states of patients with mental disorders, playing a significant role in treatment monitoring. However, due to privacy constraints, facial expression data from patients with mental disorders is severely limited. Additionally, the more complex inter-class and intra-class similarities compared to healthy individuals make accurate recognition of facial expressions challenging. Therefore, we propose a Voluntary Facial Expression Mimicry (VFEM) experiment, which collected facial expression data from schizophrenia, depression, and anxiety. This experiment establishes the first dataset designed for facial expression recognition tasks exclusively composed of patients with mental disorders. Simultaneously, based on VFEM, we propose a Vision Transformer FER model tailored for Complex mental disorder patients (CmdVIT). CmdVIT integrates crucial facial expression features through both explicit and implicit mechanisms, including explicit visual center positional encoding and implicit sparse attention center loss function. These two key components enhance positional information and minimize the facial feature space distance between conventional attention and critical attention, effectively suppressing inter-class and intraclass similarities. In various FER tasks for different mental disorders in VFEM, CmdVIT achieves more competitive performance compared to contemporary benchmark models. Our works are available at https://github.com/yjy-97/CmdVIT.

9 December 2021
Verified
Conference Paper
Closed access
YLYang Liu
Yang Liu
JWJialun Wu
Jialun Wu
YWYuhua Wei
Yuhua Wei
BMBing Mao
Bing Mao
Chen LiChen Li
Chen Li
Tieliang GongTieliang Gong
Tieliang Gong
Healthcare Representation learning has been a key element to achieving state-of-the-art performance on healthcare prediction. Recent advances based Electronic Healthcare Records(EHRs) are mostly devoted to extracting temporal progression patterns with temporal model and their variants. Although these works have shown excellent performances in healthcare prediction, the unified temporal pattern may not be suitable for individuals in all healthcare conditions. Moreover, some studies ususally introduce complex Deep Neural Networks models and medical prior knowledge to get compact representation, causing great computational burden. In this paper, we propose a general health care representation model, named AEFNet. We only leverage three simple convolution operations and a set of up and down sampling to ensure performance and model complexity equally, which achieves adaptively extract distinct individual key feature in a light manner. AEFNet can shrink and refine highly suitable scale information adaptively and comletely. Breaking traditional fixed convolution scale or multi-scale, AEFNet achieves scale adaptively to extract the most significant information and context relationship. Finally, We validate our method on the public dataset MIMIC-III, and the evaluation results indicate that our method can significantly outperform other remarkable baseline models.