Renato Panda

Renato Panda

Auto-generated profile, based on publicly available information

Renato Panda

Centre for Informatics and Systems of the University of Coimbra, Coimbra, Portugal

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 October 2020 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
RPRenato Panda
Renato Panda
Ricardo MalheiroRicardo Malheiro
Ricardo Malheiro
Rui Pedro PaivaRui Pedro Paiva
Rui Pedro Paiva
The design of meaningful audio features is a key need to advance the state-of-the-art in Music Emotion Recognition (MER). This work presents a survey on the existing emotionally-relevant computational audio features, supported by the music psychology literature on the relations between eight musical dimensions (melody, harmony, rhythm, dynamics, tone color, expressivity, texture and form) and specific emotions. Based on this review, current gaps and needs are identified and strategies for future research on feature engineering for MER are proposed, namely ideas for computational audio features that capture elements of musical form, texture and expressivity that should be further researched. Finally, although the focus of this article is on classical feature engineering methodologies (based on handcrafted features), perspectives on deep learning-based approaches are discussed.

29 March 2018 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
RPRenato Panda
Renato Panda
Ricardo MalheiroRicardo Malheiro
Ricardo Malheiro
Rui Pedro PaivaRui Pedro Paiva
Rui Pedro Paiva
This work advances the music emotion recognition state-of-the-art by proposing novel emotionally-relevant audio features. We reviewed the existing audio features implemented in well-known frameworks and their relationships with the eight commonly defined musical concepts. This knowledge helped uncover musical concepts lacking computational extractors, to which we propose algorithms - namely related with musical texture and expressive techniques. To evaluate our work, we created a public dataset of 900 audio clips, with subjective annotations following Russell's emotion quadrants. The existent audio features (baseline) and the proposed features (novel) were tested using 20 repetitions of 10-fold cross-validation. Adding the proposed features improved the F1-score to 76.4% (by 9%), when compared to a similar number of baseline-only features. Moreover, analysing the features relevance and results uncovered interesting relations, namely the weight of specific features and musical concepts to each emotion quadrant, and warrant promising new directions for future research in the field of music emotion recognition, interactive media, and novel music interfaces.

8 August 2016 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
Ricardo MalheiroRicardo Malheiro
Ricardo Malheiro
RPRenato Panda
Renato Panda
PGPaulo Gomes
Paulo Gomes
Rui Pedro PaivaRui Pedro Paiva
Rui Pedro Paiva
This research addresses the role of lyrics in the music emotion recognition process. Our approach is based on several state of the art features complemented by novel stylistic, structural and semantic features. To evaluate our approach, we created a ground truth dataset containing 180 song lyrics, according to Russell's emotion model. We conduct four types of experiments: regression and classification by quadrant, arousal and valence categories. Comparing to the state of the art features (ngrams - baseline), adding other features, including novel features, improved the F-measure from 69.9, 82.7 and 85.6 percent to 80.1, 88.3 and 90 percent, respectively for the three classification experiments. To study the relation between features and emotions (quadrants) we performed experiments to identify the best features that allow to describe and discriminate each quadrant. To further validate these experiments, we built a validation set comprising 771 lyrics extracted from the AllMusic platform, having achieved 73.6 percent F-measure in the classification by quadrants. We also conducted experiments to identify interpretable rules that show the relation between features and emotions and the relation among features. Regarding regression, results show that, comparing to similar studies for audio, we achieve a similar performance for arousal and a much better performance for valence.

29 March 2024 in Sensors
Verified
Journal Article
Open access
PDF file
PLP. L. Louro
P. L. Louro
HRHugo Redinho
Hugo Redinho
Ricardo MalheiroRicardo Malheiro
Ricardo Malheiro
Rui Pedro PaivaRui Pedro Paiva
Rui Pedro Paiva
RPRenato Panda
Renato Panda
Classical machine learning techniques have dominated Music Emotion Recognition. However, improvements have slowed down due to the complex and time-consuming task of handcrafting new emotionally relevant audio features. Deep learning methods have recently gained popularity in the field because of their ability to automatically learn relevant features from spectral representations of songs, eliminating such necessity. Nonetheless, there are limitations, such as the need for large amounts of quality labeled data, a common problem in MER research. To understand the effectiveness of these techniques, a comparison study using various classical machine learning and deep learning methods was conducted. The results showed that using an ensemble of a Dense Neural Network and a Convolutional Neural Network architecture resulted in a state-of-the-art 80.20% F1 score, an improvement of around 5% considering the best baseline results, concluding that future research should take advantage of both paradigms, that is, combining handcrafted features with feature learning.

18 April 2015 in Applied Artificial Intelligence
Verified
Journal Article
Closed access
RPRenato Panda
Renato Panda
BRBruno Rocha
Bruno Rocha
Rui Pedro PaivaRui Pedro Paiva
Rui Pedro Paiva
We propose a novel approach to music emotion recognition by combining standard and melodic features extracted directly from audio. To this end, a new audio dataset organized similarly to the one used in MIREX mood task comparison was created. From the data, 253 standard and 98 melodic features are extracted and used with several supervised learning techniques. Results show that, generally, melodic features perform better than standard audio. The best result, 64% f-measure, with only 11 features (9 melodic and 2 standard), was obtained with ReliefF feature selection and Support Vector Machines.

30 November 2023 in Biodiversity Data Journal
Verified
Journal Article
Open access
PDF file
QGQuentin Groom
Quentin Groom
MDMathias Dillen
Mathias Dillen
WAWouter Addink
Wouter Addink
AAArturo H. Ariño
Arturo H. Ariño
CBChristian Bölling
Christian Bölling
JGJitendra Gaikwad
Jitendra Gaikwad
Tens of millions of images from biological collections have become available online over the last two decades. In parallel, there has been a dramatic increase in the capabilities of image analysis technologies, especially those involving machine learning and computer vision. While image analysis has become mainstream in consumer applications, it is still used only on an artisanal basis in the biological collections community, largely because the image corpora are dispersed. Yet, there is massive untapped potential for novel applications and research if images of collection objects could be made accessible in a single corpus. In this paper, we make the case for infrastructure that could support image analysis of collection objects. We show that such infrastructure is entirely feasible and well worth investing in.