Speech emotion recognition (SER) is the process of predicting human emotions from audio signals using artificial intelligence (AI) techniques. SER technologies have a wide range of applications in areas such as psychology, medicine, education, and entertainment. Extracting relevant features from audio signals is a crucial task in the SER process to correctly identify emotions. Several studies on SER have employed short-time features such as Mel frequency cepstral coefficients (MFCCs), due to their efficiency in capturing the periodic nature of audio signals. However, these features are limited in their ability to correctly identify emotion representations. To solve this issue, this research combined MFCCs and time-domain features (MFCCT) to enhance the performance of SER systems. The proposed hybrid features were given to a convolutional neural network (CNN) to build the SER model. The hybrid MFCCT features together with CNN outperformed both MFCCs and time-domain (t-domain) features on the Emo-DB, SAVEE, and RAVDESS datasets by achieving an accuracy of 97%, 93%, and 92% respectively. Additionally, CNN achieved better performance compared to the machine learning (ML) classifiers that were recently used in SER. The proposed features have the potential to be widely utilized to several types of SER datasets for identifying emotions.
This study proposed an AlexNet-based crowd anomaly detection model in the video (image frames). The proposed model was comprised of four convolution layers (CLs) and three Fully Connected layers (FC). The Rectified Linear Unit (ReLU) was used as an activation function, and weights were adjusted through the backpropagation process. The first two CLs are followed by max-pool layer and batch normalization. The CLs produced features that are utilized to detect the anomaly in the image frame. The proposed model was evaluated using two parameters—Area Under the Curve (AUC) using Receiver Operator Characteristic (ROC) curve and overall accuracy. Three benchmark datasets comprised of numerous video frames with various abnormal and normal actions were used to evaluate the performance. Experimental results revealed that the proposed model outperformed other baseline studies on all three datasets and achieved 98% AUC using the ROC curve. Moreover, the proposed model achieved 95.6%, 98%, and 97% AUC on the CUHK Avenue, UCSD Ped-1, and UCSD Ped-2 datasets, respectively.
In recent years data science has been applied in a variety of real-life applications such as human-computer interaction applications, computer gaming, mobile services, and emotion evaluation. Among the wide range of applications, speech emotion recognition (SER) is also an emerging and challenging research topic. For SER, recent studies used handcrafted features that provide the best results but failed to provide accuracy while applied in complex scenarios. Later, deep learning techniques were used for SER that automatically detect features from speech signals. Deep learning-based SER techniques overcome the issues of accuracy, yet there are still significant gaps in the reported methods. Studies using lightweight CNN failed to learn optimal features from composite acoustic signals. This study proposed a novel SER model to overcome the limitations mentioned earlier in this study. We focused on Arabic vocal emotions in particular because they received relatively little attention in research. The proposed model performs data augmentation before feature extraction. The 273 derived features were fed as input to the transformer model for emotion recognition. This model is applied to four datasets named BAVED, EMO-DB, SAVEE, and EMOVO. The experimental findings demonstrated the robust performance of the proposed model compared to existing techniques. The proposed SER model achieved 95.2%, 93.4%, 85.1%, and 91.7% accuracy on BAVED, EMO-DB, SAVEE, and EMOVO datasets respectively. The highest accuracy was obtained using BAVED dataset, indicating that the proposed model is well suited to Arabic vocal emotions.
Evapotranspiration (ET) is the fundamental component of efficient water resource management. Accurate forecasting of ET is essential for efficient water utilization in agriculture. ET forecasting is a complex process due to the requirements of large meteorological variables. The recommended approach is based on the Internet of Things (IoT) and an ensemble-learning-based approach for meteorological data collection and ET forecasting with limited meteorological conditions. IoT is part of the recommended approach to collect real-time data on meteorological variables. The daily maximum temperature (T), mean humidity (Hm), and maximum wind speed (Ws) are used to forecast evapotranspiration (ET). Long short-term memory (LSTM) and ensemble LSTM with bagged and boosted approaches are implemented and evaluated for their accuracy in forecasting ET values using meteorological data from 2001 to 2023. The results demonstrate that the bagged LSTM approach accurately forecasts ET with limited meteorological conditions in Riyadh, Saudi Arabia, with the coefficient of determination (R) of 0.94 compared to the boosted LSTM and off-the-shelf LSTM with R of 0.91 and 0.77, respectively. The bagged LSTM model is also more efficient with small values of root mean squared error (RMSE) and mean squared error (MSE) of 0.42 and 0.53 compared to the boosted LSTM and off-the-shelf LSTM models.
28 September 2024 in VFAST Transactions on Software Engineering
Sarcasm is a term used to criticize someone's feelings. Sometimes, humans are not able to identify sarcastic comments, and they typically express the reverse of what they mean when they make snarky remarks. Therefore, the detection of sarcasm within a text automatically is a difficult task. Its significance in enhancing sentiment analysis has also made it an important study field. In previous studies, different approaches to deep learning (DL) and machine learning (ML) have been explored. However, previous approaches mainly depend on the lexical and linguistic aspects. Therefore, these techniques could not perform well in the context of sentiment accuracy. In this research, an efficient approach for detecting sarcasm is proposed. A Bidirectional Encoder Representation from a Transformer (BERT) is proposed to improve the sentiment accuracy in this research. This research also aims to compare the two models of deep learning, the BERT and LSTM (Long Short-Term Memory) models. This comparative analysis aims to provide a detailed overview of the pros and cons of each approach for the detection of sarcasm. The primary aim of this study is to examine the different existing ML and DL approaches for the identification of sarcasm. Apart from this, the comparison of BERT and LSTM contributes to the ongoing debate about whether models work best for sarcasm detection in social media. In this study, sentiment analysis's accuracy is improved by making better decisions, especially when it concerns Twitter interactions.
The proliferation of big data for web-enabled technologies allows users to publish their views, suggestions, sentiments, emotions, and opinionative content about several real-world entities. These available opinionative texts have greater importance to those who are inquisitive about their desired entities, but it becomes an arduous task to capture such a massive volume of user-generated content. Emotions are an inseparable part of communication, which is articulated in multiple ways and can be used for making better decisions to reshape business strategies. Emotion detection is a subdiscipline at the crossroads of text mining and information retrieval. Context is a common phenomenon in emotions and is inherently hard to capture not only for the machine but even for a human. This study proposes a decision-making framework for efficient emotion detection of mobile reviews. An unsupervised lexicon-based algorithm has been developed to tackle the problem of emotion prediction. Dictionaries and corpora are used as backend resources in the semantic orientation of emotion words, whereas the major contribution is to cope with contextualized emotion detection. The proposed framework outperformed the existing emotion detection systems by achieving 86% accuracy over mobile reviews.