Noushin Hajarolasvadi

Mrs. Noushin Hajarolasvadi

orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 May 2019 in Entropy
Verified
Journal Article
Open access
PDF file
NHNoushin Hajarolasvadi
Noushin Hajarolasvadi
HDHasan Demirel
Hasan Demirel
Detecting human intentions and emotions helps improve human–robot interactions. Emotion recognition has been a challenging research direction in the past decade. This paper proposes an emotion recognition system based on analysis of speech signals. Firstly, we split each speech signal into overlapping frames of the same length. Next, we extract an 88-dimensional vector of audio features including Mel Frequency Cepstral Coefficients (MFCC), pitch, and intensity for each of the respective frames. In parallel, the spectrogram of each frame is generated. In the final preprocessing step, by applying k-means clustering on the extracted features of all frames of each audio signal, we select k most discriminant frames, namely keyframes, to summarize the speech signal. Then, the sequence of the corresponding spectrograms of keyframes is encapsulated in a 3D tensor. These tensors are used to train and test a 3D Convolutional Neural network using a 10-fold cross-validation approach. The proposed 3D CNN has two convolutional layers and one fully connected layer. Experiments are conducted on the Surrey Audio-Visual Expressed Emotion (SAVEE), Ryerson Multimedia Laboratory (RML), and eNTERFACE’05 databases. The results are superior to the state-of-the-art methods reported in the literature.

30 April 2018 in IEEE Access
Verified
Journal Article
Open access
JGJianzhu Guo
Jianzhu Guo
ZLZhen Lei
Zhen Lei
JWJun Wan
Jun Wan
EAEgils Avots
Egils Avots
NHNoushin Hajarolasvadi
Noushin Hajarolasvadi
Gholamreza AnbarjafariGholamreza Anbarjafari
Gholamreza Anbarjafari
Emotion recognition has a key role in affective computing. Recently, fine-grained emotion analysis, such as compound facial expression of emotions, has attracted high interest of researchers working on affective computing. A compound facial emotion includes dominant and complementary emotions (e.g. happily-disgusted, sadly-fearful), which is more detailed than the seven classical facial emotions (e.g. happy, disgust, etc.). Current studies on compound emotions are limited to use datasets with limited number of categories and unbalanced data distributions, with labels obtained automatically by machine learning-based algorithms which could lead to inaccuracies. To address these problems, we released the iCV-MEFED dataset, which includes 50 classes of compound emotions and labels assessed by psychologists. The task is challenging due to high similarities of compound facial emotions from different categories. In addition, we have organized a challenge based on the proposed iCV-MEFED dataset, held at FG workshop 2017. In this paper, we analyze the top three winner methods and perform further detailed experiments on the proposed dataset. Experiments indicate that pairs of compound emotion (e.g. surprisingly-happy vs happily-surprised) are more difficult to be recognized if compared to the seven basic emotions. However, we hope the proposed dataset can help to pave the way for further research on compound facial emotion recognition.

10 October 2022 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
SMSaeed Mohammadzadeh
Saeed Mohammadzadeh
VNVítor Heloiz Nascimento
Vítor Heloiz Nascimento
RLRodrigo de Lamare
Rodrigo de Lamare
NHNoushin Hajarolasvadi
Noushin Hajarolasvadi
Robust adaptive beamforming (RAB) plays a vital role in modern communications by ensuring the reception of high-quality signals. This paper proposes a deep learning approach to robust adaptive beamforming. In particular, we propose a novel RAB approach where the sample covariance matrix (SCM) is used as the input of a deep 1D Complex-Valued Convolutional Neural Network (CVCNN). The network employs complex convolutional and pooling layers, as well as a Cartesian Scaled Exponential Linear Unit activation function to directly compute the nearly-optimum weight vector through the training process and without prior knowledge about the direction of arrival of the desired signal. This means that reconstruction of the interference plus noise (IPN) covariance matrix is not required. The trained CVCNN accurately computes the nearly-optimum weight vector for data not used during training. The computed weight vector is employed to estimate the signal-to-interference plus noise ratio. Simulations show that the proposed RAB can provide performance close to that of the optimal beamformer.

3 December 2020 in IEEE Access
Verified
Journal Article
Open access
NHNoushin Hajarolasvadi
Noushin Hajarolasvadi
Miguel Arjona RamírezMiguel Arjona Ramírez
Miguel Arjona Ramírez
WBWesley Beccaro
Wesley Beccaro
HDHasan Demirel
Hasan Demirel
Deep generative models have become an emerging topic in various research areas like computer vision and signal processing. These models allow synthesizing realistic data samples that are of great value for both academic and industrial communities. Affective computing, a topic of a broad interest in computer vision society, has been no exception and has benefited from this powerful approach. In fact, affective computing observed a rapid derivation of generative models during the last two decades. Applications of such models include but are not limited to emotion recognition and classification, unimodal emotion synthesis, and cross-modal emotion synthesis. As a result, we conducted a comprehensive survey of recent advances in human emotion synthesis by studying available databases, advantages, and disadvantages of the generative models along with the related training strategies considering two principal human communication modalities, namely audio and video. In this context, facial expression synthesis, speech emotion synthesis, and the audio-visual (cross-modal) emotion synthesis are reviewed extensively under different application scenarios. Gradually, we discuss open research problems to push the boundaries of this research area for future works. As conclusions, we indicate common problems that can be explored from the Generative Adversarial Networks (GAN) topologies and applications in emotion synthesis.

14 October 2020 in IET Image Processing
Verified
Journal Article
Open access
PDF file
NHNoushin Hajarolasvadi
Noushin Hajarolasvadi
HDHasan Demirel
Hasan Demirel
Recently, video‐based facial emotion recognition (FER) has been an attractive topic in the computer vision society. However, processing several hundreds of frames for a single video of a particular emotion is not efficient. In this study, the authors propose a novel approach to obtain a representative set of frames for a video in the eigenspace domain. Principal component analysis (PCA) is applied to a single emotional video extracting the most significant eigenframes representing the temporal motion variance embedded in the video. Given that faces are segmented and normalised, the variance captured by PCA is attributed to the facial expression dynamics. The variation in the temporal domain is mapped to the eigenspace reducing the redundancy. The proposed approach is used to extract the input eigenframes. Later, VGG‐16, ResNet50, and 2D and 3D CNN architectures called eigenFaceNet are trained on the RML, eNTERFACE′05, and AFEW 6.0 databases. The experimental results are superior to the state‐of‐the‐art by 8 and 4% for RML, eNTERFACE′05 databases, respectively. The performance achievement is also coupled with a reduction in the computational time.

19 January 2021 in Signal, Image and Video Processing
Verified
Journal Article
Closed access
PDF file
NHNoushin Hajarolasvadi
Noushin Hajarolasvadi
EBEnver Bashirov
Enver Bashirov
HDHasan Demirel
Hasan Demirel