Rafael Ramirez-Melendez

Dr. Rafael Ramirez-Melendez

Universitat Pompeu Fabra (UPF), Barcelona 08003, Spain
orcid

Research Focus & Metrics

Academic Career Length

32Years (1995-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2012
Verified
Book Chapter
Closed access
PDF file
RRRafael Ramirez-Melendez
Rafael Ramirez-Melendez
ZVZacharias Vamvakousis
Zacharias Vamvakousis

2 October 2015 in Frontiers in Neuroscience
Verified
Journal Article
Open access
RRRafael Ramirez-Melendez
Rafael Ramirez-Melendez
MPManel Palencia-Lefler
Manel Palencia-Lefler
SGSergio Giraldo
Sergio Giraldo
ZVZacharias Vamvakousis
Zacharias Vamvakousis
We introduce a new neurofeedback approach, which allows users to manipulate expressive parameters in music performances using their emotional state, and present the results of a pilot clinical experiment applying the approach to alleviate depression in elderly people. Ten adults (9 female, mean=84, SD=5.8) with normal hearing participated in the neurofeedback study consisting of 10 sessions of 15 minutes each. EEG data was acquired using the Emotiv EPOC EEG device. In all sessions, participants listened to music pieces preselected according to their music preferences, and were encouraged to increase the loudness and tempo of the pieces, based on their arousal and valence levels. Increased arousal, computed as beta to alpha activity ratio in the frontal cortex corresponded to increased loudness, and increased valence, computed as relative frontal alpha activity in the right lobe compared to the left lobe, corresponded to increased tempo. Pre and post evaluation of 6 participants was performed using the BDI depression test, showing an average improvement of 17.2% (1.3) in their BDI scores at the end of the study. In addition, an analysis of the collected EEG data of the participants showed a significant decrease of relative alpha activity in their left frontal lobe.

2 March 2018 in Frontiers in Psychology
Verified
Journal Article
Open access
PDF file
RRRafael Ramirez-Melendez
Rafael Ramirez-Melendez
JPJosep Planas
Josep Planas
NENuria Escude
Nuria Escude
JMJordi Mercade
Jordi Mercade
CFCristina Farriols
Cristina Farriols
Music is known to have the power to induce strong emotions. The present study assessed, based on Electroencephalography (EEG) data, the emotional response of terminally ill cancer patients to a music therapy intervention in a randomized controlled trial. A sample of 40 participants from the palliative care unit in the Hospital del Mar in Barcelona was randomly assigned to two groups of 20. The first group [experimental group (EG)] participated in a session of music therapy (MT), and the second group [control group (CG)] was provided with company. Based on our previous work on EEG-based emotion detection, instantaneous emotional indicators in the form of a coordinate in the arousal-valence plane were extracted from the participants’ EEG data. The emotional indicators were analyzed in order to quantify (1) the overall emotional effect of MT on the patients compared to controls, and (2) the relative effect of the different MT techniques applied during each session. During each MT session, five conditions were considered: I (initial patient’s state before MT starts), C1 (passive listening), C2 (active listening), R (relaxation), and F (final patient’s state). EEG data analysis showed a significant increase in valence (p = 0.0004) and arousal (p = 0.003) between I and F in the EG. No significant changes were found in the CG. This results can be interpreted as a positive emotional effect of MT in advanced cancer patients. In addition, according to pre- and post-intervention questionnaire responses, participants in the EG also showed a significant decrease in tiredness, anxiety and breathing difficulties, as well as an increase in levels of well-being. No equivalent changes were observed in the CG.

4 March 2019 in Frontiers in Psychology
Verified
Journal Article
Open access
PDF file
DDDavid Dalmazzo
David Dalmazzo
RRRafael Ramirez-Melendez
Rafael Ramirez-Melendez
Gestures in music are of paramount importance partly because they are directly linked to musicians' sound and expressiveness. At the same time, current motion capture technologies are capable of detecting body motion/gestures details very accurately. We present a machine learning approach to automatic violin bow gesture classification based on Hierarchical Hidden Markov Models (HHMM) and motion data. We recorded motion and audio data corresponding to seven representative bow techniques (Détaché, Martelé, Spiccato, Ricochet, Sautillé, Staccato, and Bariolage) performed by a professional violin player. We used the commercial Myo device for recording inertial motion information from the right forearm and synchronized it with audio recordings. Data was uploaded into an online public repository. After extracting features from both the motion and audio data, we trained an HHMM to identify the different bowing techniques automatically. Our model can determine the studied bowing techniques with over 94% accuracy. The results make feasible the application of this work in a practical learning scenario, where violin students can benefit from the real-time feedback provided by the system.

23 September 2021 in Virtual Reality
Verified
Journal Article
Open access
PDF file
BSBatuhan Sayis
Batuhan Sayis
RRRafael Ramirez-Melendez
Rafael Ramirez-Melendez
Narcis ParesNarcis Pares
Narcis Pares
This study extends the previous research in which it has been shown that a mixed reality (MR) system fosters social interaction behaviours (SIBs) in children with Autism Spectrum Condition (ASC). When comparing this system to a LEGO-based non-digital intervention, it has been observed that an MR system effectively mediates a face-to-face play session between a child with ASC and a child without ASC providing new specific advantageous properties (e.g. not being a passive tool, not needing to be guided by the therapist). Considering the newly collected multimodal data totaling to 72 children (36 trials of dyads, child with ASC/child without ASC), a first goal of the present study is to apply detailed statistical inference and machine learning techniques to extensively evaluate the overall effect of this MR system, when compared to the LEGO condition. This goal also includes the analysis of psychophysiological data and allows the context-driven triangulation of the multimodal data which is operationalized by (i) video-coding of SIBs, (ii) psychophysiological data, and (iii) system logs of user-system events. A second goal is to show how SIBs, taking place in these experiences, are influenced by the internal states of the users and the system. SIBs were measured by video-coding overt behaviours (Initiation, Response and Externalization) and with self-reports. Internal states were measured using a wearable device designed by the FuBIntLab (Full-Body Interaction Lab) to acquire: Electrocardiogram (ECG) and Electrodermal Activity (EDA) data. Affective sliders and State Trait Anxiety Scale questionnaires were used as self-reports. Repeated-measures design was chosen with two conditions, the MR environment and the traditional therapy LEGO. The results show that the MR system has a positive effect on SIBs when compared to the LEGO condition, with an added advantage of being more flexible.

3 May 2016 in Journal of Mathematics and Music
Verified
Journal Article
Open access
KKKaterina Kosta
Katerina Kosta
RRRafael Ramirez-Melendez
Rafael Ramirez-Melendez
OBOscar F. Bandtlow
Oscar F. Bandtlow
ECElaine Chew
Elaine Chew
Loudness variation is one of the foremost tools for expressivity in music performance. Loudness is frequently notated as dynamic markings such as p (piano, meaning soft) or f (forte, meaning loud). While dynamic markings in music scores are important indicators of how music pieces should be interpreted, their meaning is less straightforward than it may seem, and depends highly on the context in which they appear. In this article, we investigate the relationship between dynamic markings in the score and performed loudness by applying machine learning techniques – decision trees, support vector machines, artificial neural networks, and a k-nearest neighbor method – to the prediction of loudness levels corresponding to dynamic markings, and to the classification of dynamic markings given loudness values. The methods are applied to 44 recordings of performances of Chopin's Mazurkas, each by 8 pianists. The results show that loudness values and markings can be predicted relatively well when trained across recordings of the same piece, but fail dismally when trained across the pianist's recordings of other pieces, demonstrating that score features may trump individual style when modeling loudness choices. Evidence suggests that all the features chosen for the task are relevant, and analysis of the results reveals the forms (such as the return of the theme) and structures (such as dynamic-marking repetitions) that influence the predictability of loudness and markings. Modeling of loudness trends in expressive performance appears to be a delicate matter, and sometimes loudness expression can be a matter of the performer's idiosyncracy.