Muhammad Ali Arshad

Dr. Muhammad Ali Arshad


Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 March 2025 in AI
Verified
Journal Article
Open access
PDF file
Abdur RasoolAbdur Rasool
Abdur Rasool
MSMuhammad Irfan Shahzad
Muhammad Irfan Shahzad
HAHafsa Aslam
Hafsa Aslam
VCVincent Chan
Vincent Chan
MAMuhammad Ali Arshad
Muhammad Ali Arshad
Empathetic and coherent responses are critical in automated chatbot-facilitated psychotherapy. This study addresses the challenge of enhancing the emotional and contextual understanding of large language models (LLMs) in psychiatric applications. We introduce Emotion-Aware Embedding Fusion, a novel framework integrating hierarchical fusion and attention mechanisms to prioritize semantic and emotional features in therapy transcripts. Our approach combines multiple emotion lexicons, including NRC Emotion Lexicon, VADER, WordNet, and SentiWordNet, with state-of-the-art LLMs such as Flan-T5, Llama 2, DeepSeek-R1, and ChatGPT 4. Therapy session transcripts, comprising over 2000 samples, are segmented into hierarchical levels (word, sentence, and session) using neural networks, while hierarchical fusion combines these features with pooling techniques to refine emotional representations. Attention mechanisms, including multi-head self-attention and cross-attention, further prioritize emotional and contextual features, enabling the temporal modeling of emotional shifts across sessions. The processed embeddings, computed using BERT, GPT-3, and RoBERTa, are stored in the Facebook AI similarity search vector database, which enables efficient similarity search and clustering across dense vector spaces. Upon user queries, relevant segments are retrieved and provided as context to LLMs, enhancing their ability to generate empathetic and contextually relevant responses. The proposed framework is evaluated across multiple practical use cases to demonstrate real-world applicability, including AI-driven therapy chatbots. The system can be integrated into existing mental health platforms to generate personalized responses based on retrieved therapy session data. The experimental results show that our framework enhances empathy, coherence, informativeness, and fluency, surpassing baseline models while improving LLMs’ emotional intelligence and contextual adaptability for psychotherapy.

27 September 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
ARAdnan Riaz
Adnan Riaz
HRHameedur Rahman
Hameedur Rahman
MAMuhammad Ali Arshad
Muhammad Ali Arshad
MNMUHAMMAD NABEEL
MUHAMMAD NABEEL
Affan YasinAffan Yasin
Affan Yasin
NGNivin A. Ghamry
Nivin A. Ghamry
Traffic speed prediction is a vital part of the intelligent transportation system (ITS). Predicting accurate traffic speed is becoming an important and challenging task with the rapid development of deep learning and increasing traffic data size. In this study, we present a deep-learning-based architecture for network-wide traffic speed prediction. We propose a deep-learning-based model consisting of a fully convolutional neural network, bidirectional long short-term memory, and attention mechanism. Our design aims to consider both backward and forward dependencies of traffic data to predict multistep network-wide traffic speed. Thus, we propose a model named AttBDLTSM-FCN for multistep traffic speed prediction. We augmented the attention-based bidirectional long short-term memory recurrent neural network with the fully convolutional network to predict the network-wide traffic speed. In traffic speed prediction, this is the first time that augmentation of AttBDLSTM and FCN have been exploited to measure the backward dependency of traffic data, as a building block for a deep architecture model. We conducted comprehensive experiments, and the experimental evaluations illustrated that the proposed architecture achieved better performance compared to state-of-the-art models when considering the short and long traffic speed prediction, e.g., 15, 30, and 60 min, in multistep traffic speed prediction.

1 February 2021 in Journal of Physics: Conference Series
Verified
Conference Paper
Open access
PDF file
MAMuhammad Ali Arshad
Muhammad Ali Arshad
ZHZhiqiu Huang
Zhiqiu Huang
Bug tracking systems (BTS) are a resource for receiving bug reports that help to improve software applications. They usually contain reports reported by the end-users or developers. Bug Reports contain some suggestions, complaints, etc. The problem is that every submitted bug report is not accepted to implement. Mostly bug reports are rejected because they are incomplete, duplicate, expired, etc. while only a few are accepted to implement. But the developers have to check every bug report manually that needs many resources (i.e. labour, money, time). In this study, we proposed a convolutional neural network (CNN) based approach to automatically classify bug reports as accepted and rejected. Results show that the proposed approach achieves the highest performance as compared to closely related works.