Eleni Tsalera

Dr. Eleni Tsalera

University of West Attica, Athens, Attikí, Greece
+1
orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
Verified
Journal Article
Open access
PDF file
Eleni TsaleraEleni Tsalera
Eleni Tsalera
Andreas PapadakisAndreas Papadakis
Andreas Papadakis
Maria SamarakouMaria Samarakou
Maria Samarakou
The paper investigates retraining options and the performance of pre-trained Convolutional Neural Networks (CNNs) for sound classification. CNNs were initially designed for image classification and recognition, and, at a second phase, they extended towards sound classification. Transfer learning is a promising paradigm, retraining already trained networks upon different datasets. We selected three ‘Image’- and two ‘Sound’-trained CNNs, namely, GoogLeNet, SqueezeNet, ShuffleNet, VGGish, and YAMNet, and applied transfer learning. We explored the influence of key retraining parameters, including the optimizer, the mini-batch size, the learning rate, and the number of epochs, on the classification accuracy and the processing time needed in terms of sound preprocessing for the preparation of the scalograms and spectrograms as well as CNN training. The UrbanSound8K, ESC-10, and Air Compressor open sound datasets were employed. Using a two-fold criterion based on classification accuracy and time needed, we selected the ‘champion’ transfer-learning parameter combinations, discussed the consistency of the classification results, and explored possible benefits from fusing the classification estimations. The Sound CNNs achieved better classification accuracy, reaching an average of 96.4% for UrbanSound8K, 91.25% for ESC-10, and 100% for the Air Compressor dataset.

1 November 2020 in Energy Reports
Verified
Journal Article
Open access
Eleni TsaleraEleni Tsalera
Eleni Tsalera
APAndreas Papadakis
Andreas Papadakis
MSMaria Samarakou
Maria Samarakou

24 August 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
Eleni TsaleraEleni Tsalera
Eleni Tsalera
Andreas PapadakisAndreas Papadakis
Andreas Papadakis
Maria SamarakouMaria Samarakou
Maria Samarakou
Ioannis VoyiatzisIoannis Voyiatzis
Ioannis Voyiatzis
This research compares the facial expression recognition accuracy achieved using image features extracted (a) manually through handcrafted methods and (b) automatically through convolutional neural networks (CNNs) from different depths, with and without retraining. The Karolinska Directed Emotional Faces, Japanese Female Facial Expression, and Radboud Faces Database databases have been used, which differ in image number and characteristics. Local binary patterns and histogram of oriented gradients have been selected as handcrafted methods and the features extracted are examined in terms of image and cell size. Five CNNs have been used, including three from the residual architecture of increasing depth, Inception_v3, and EfficientNet-B0. The CNN-based features are extracted from the pre-trained networks from the 25%, 50%, 75%, and 100% of their depths and, after their retraining on the new databases. Each method is also evaluated in terms of calculation time. CNN-based feature extraction has proved to be more efficient since the classification results are superior and the computational time is shorter. The best performance is achieved when the features are extracted from shallower layers of pre-trained CNNs (50% or 75% of their depth), achieving high accuracy results with shorter computational time. CNN retraining is, in principle, beneficial in terms of classification accuracy, mainly for the larger databases by an average of 8%, also increasing the computational time by an average of 70%. Its contribution in terms of classification accuracy is minimal when applied in smaller databases. Finally, the effect of two types of noise on the models is examined, with ResNet50 appearing to be the most robust to noise.
1

10 June 2023 in Energy Reports
Verified
Journal Article
Open access
Eleni TsaleraEleni Tsalera
Eleni Tsalera
APAndreas Papadakis
Andreas Papadakis
IVIoannis Voyiatzis
Ioannis Voyiatzis
MSMaria Samarakou
Maria Samarakou

29 May 2021 in Computational Intelligence
Verified
Journal Article
Closed access
PDF file
Eleni TsaleraEleni Tsalera
Eleni Tsalera
Andreas PapadakisAndreas Papadakis
Andreas Papadakis
MSMaria Samarakou
Maria Samarakou

Verified
Journal Article
Open access
PDF file
Eleni TsaleraEleni Tsalera
Eleni Tsalera
Andreas PapadakisAndreas Papadakis
Andreas Papadakis
Gerasimos PagiatakisGerasimos Pagiatakis
Gerasimos Pagiatakis
Maria SamarakouMaria Samarakou
Maria Samarakou
We investigate the impact of dataset augmentation and synthetic generation techniques on the accuracy of supervised audio classification based on state-of-the-art neural networks used as classifiers. Dataset augmentation techniques are applied upon the raw sound and its transformed image format. Specifically, sound augmentation techniques are applied prior to spectral-based transformation and include time stretching, pitch shifting, noise addition, volume controlling, and time shifting. Image augmentation techniques are applied after the transformation of the sound into a scalogram, involving scaling, shearing, rotation, and translation. Synthetic sound generation is based on the AudioGen generative model, triggered through a series of customized prompts. Augmentation and synthetic generation are applied to three sound categories: (a) human sounds, (b) animal sounds, and (c) sounds of things, with each category containing ten sound classes with 20 samples retrieved from the ESC-50 dataset. Sound- and image-orientated neural network classifiers have been used to classify the augmented datasets and their synthetic additions. VGGish and YAMNet (sound classifiers) employ spectrograms, while ResNet50 and DarkNet53 (image classifiers) employ scalograms. The streamlined AI-based process of augmentation and synthetic generation, enhanced classifier fine-tuning and inference allowed for a consistent, multicriteria-comparison of the impact. Classification accuracy has increased for all augmentation and synthetic generation scenarios; however, the increase has not been uniform among the techniques, the sound types, and the percentage of the training set population increase. The average increase in classification accuracy ranged from 2.05% for ResNet50 to 9.05% for VGGish. Our findings reinforce the benefit of audio augmentation and synthetic generation, providing guidelines to avoid accuracy degradation due to overuse and distortion of key audio features.