Andres Pinilla

Andres Pinilla

Auto-generated profile, based on publicly available information

Andres Pinilla

Quality and Usability Lab, Institute for Software Technology and Theoretical Computer Science, Faculty of Electrical Engineering and Computer Science, Technische Universitat Berlin, Berlin, Germany

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 August 2021 in Frontiers in Virtual Reality
Verified
Journal Article
Open access
APAndres Pinilla
Andres Pinilla
JGJaime Garcia
Jaime Garcia
WRWilliam Raffe
William Raffe
JVJan-Niklas Voigt-Antons
Jan-Niklas Voigt-Antons
RSRobert P. Spang
Robert P. Spang
SMSebastian Möller
Sebastian Möller
A cluster of research in Affective Computing suggests that it is possible to infer some characteristics of users’ affective states by analyzing their electrophysiological activity in real-time. However, it is not clear how to use the information extracted from electrophysiological signals to create visual representations of the affective states of Virtual Reality (VR) users. Visualization of users’ affective states in VR can lead to biofeedback therapies for mental health care. Understanding how to visualize affective states in VR requires an interdisciplinary approach that integrates psychology, electrophysiology, and audio-visual design. Therefore, this review aims to integrate previous studies from these fields to understand how to develop virtual environments that can automatically create visual representations of users’ affective states. The manuscript addresses this challenge in four sections: First, theories related to emotion and affect are summarized. Second, evidence suggesting that visual and sound cues tend to be associated with affective states are discussed. Third, some of the available methods for assessing affect are described. The fourth and final section contains five practical considerations for the development of virtual reality environments for affect visualization.

1 May 2020
Verified
Conference Paper
Closed access
JVJan-Niklas Voigt-Antons
Jan-Niklas Voigt-Antons
ELEero Lehtonen
Eero Lehtonen
APAndres Pinilla Palacios
Andres Pinilla Palacios
DADanish Ali
Danish Ali
TKTanja Kojic
Tanja Kojic
SMSebastian Moller
Sebastian Moller
In recent years 360° videos have been becoming more popular. For traditional media presentations, e.g., on a computer screen, a wide range of assessment methods are available. Different constructs, such as perceived quality or the induced emotional state of viewers, can be reliably assessed by subjective scales. Many of the subjective methods have only been validated using stimuli presented on a computer screen. This paper is using 360° videos to induce varying emotional states. Videos were presented 1) via a head-mounted display (HMD) and 2) via a traditional computer screen. Furthermore, participants were asked to rate their emotional state 1) in retrospect on the self-assessment manikin scale and 2) continuously on a 2-dimensional arousal-valence plane. In a repeated measures design, all participants (N = 18) used both presentation systems and both rating systems. Results indicate that there is a statistically significant difference in induced presence due to the presentation system. Furthermore, there was no statistically significant difference in ratings gathered with the two presentation systems. Finally, it was found that for arousal measures, a statistically significant difference could be found for the different rating methods, potentially indicating an underestimation of arousal ratings gathered in retrospect for screen presentation. In the future, rating methods such as a 2-dimensional arousal-valence plane could offer the advantage of enabling a reliable measurement of emotional states while being more embedded in the experience itself, enabling a more precise capturing of the emotional states.

31 January 2020 in Frontiers in Psychology
Verified
Journal Article
Open access
PDF file
APAndrés Pinilla
Andrés Pinilla
RTRicardo M. Tamayo
Ricardo M. Tamayo
JNJorge Neira
Jorge Neira
Affective states can propagate in a group of people and influence their ability to judge others’ affective states. In the present paper, we present a simple mathematical model to describe this process in a three-dimensional affective space. We obtained data from 67 participants randomly assigned to two experimental groups. Participants watched either an upsetting or uplifting video previously calibrated for this goal. Immediately, participants reported their baseline subjective affect in three dimensions: (1) positivity, (2) negativity, and (3) arousal. In a second phase, participants rated the affect they subjectively judged from 10 target angry faces and ten target happy faces in the same three-dimensional scales. These judgments were used as an index of participant’s affective state after observing the faces. Participants’ affective responses were subsequently mapped onto a simple three-dimensional model of emotional contagion, in which the shortest distance between the baseline self-reported affect and the target judgment was calculated. The results display a double dissociation: negatively induced participants show more emotional contagion to angry than happy faces, while positively induced participants show more emotional contagion to happy than angry faces. In sum, emotional contagion exerted by the videos selectively affected judgments of the affective state of others’ faces. We discuss the directionality of emotional contagion to faces, considering whether negative emotions are more easily propagated than positive ones. Additionally, we comment on the lack of significant correlations between our model and standardized tests of empathy and emotional contagion.

5 January 2023 in Frontiers in Virtual Reality
Verified
Journal Article
Open access
APAndres Pinilla
Andres Pinilla
JVJan-Niklas Voigt-Antons
Jan-Niklas Voigt-Antons
JGJaime Garcia
Jaime Garcia
WRWilliam Raffe
William Raffe
SMSebastian Möller
Sebastian Möller
This manuscript explores the development of a technique for detecting the affective states of Virtual Reality (VR) users in real-time. The technique was tested with data from an experiment where 18 participants observed 16 videos with emotional content inside a VR home theater, while their electroencephalography (EEG) signals were recorded. Participants evaluated their affective response toward the videos in terms of a three-dimensional model of affect. Two variants of the technique were analyzed. The difference between both variants was the method used for feature selection. In the first variant, features extracted from the EEG signals were selected using Linear Mixed-Effects (LME) models. In the second variant, features were selected using Recursive Feature Elimination with Cross Validation (RFECV). Random forest was used in both variants to build the classification models. Accuracy, precision, recall and F1 scores were obtained by cross-validation. An ANOVA was conducted to compare the accuracy of the models built in each variant. The results indicate that the feature selection method does not have a significant effect on the accuracy of the classification models. Therefore, both variations (LME and RFECV) seem equally reliable for detecting affective states of VR users. The mean accuracy of the classification models was between 87% and 93%.

3 March 2025 in PsyArXiv
Verified
Preprint
Open access
APAndres Pinilla
Andres Pinilla
JGJaime Garcia
Jaime Garcia
WRWilliam Raffe
William Raffe
JVJan-Niklas Voigt-Antons
Jan-Niklas Voigt-Antons
SMSebastian Möller
Sebastian Möller
Previous studies support the existence of objective emotional visual cues. Forinstance, red and blue are usually associated with high and low arousal, respectively. A similar phenomenon has been observed with other colors, as well as textures, shapes, and motion patterns. Yet, it is not clear to which extent this phenomenon can be extrapolated to Virtual Reality (VR) stimuli. Therefore, this manuscript presents an experiment where five virtual environments were evaluated by 21 participants in terms of valence and arousal. The design of the virtual environments was informed by evidence found in previous studies. Each environment represents one of the four quadrants of the Circumplex Model of Affect, plus a neutral environment. The results suggest that the emotions associated with the virtual environments are consistent with the evidence used to inform the designprocess. Individual differences across participants do not seem to influence the evaluation of the visual cues.

17 April 2023 in Frontiers in Virtual Reality
Verified
Journal Article
Open access
APAndres Pinilla
Andres Pinilla
JVJan-Niklas Voigt-Antons
Jan-Niklas Voigt-Antons
JGJaime Garcia
Jaime Garcia
WRWilliam Raffe
William Raffe
SMSebastian Möller
Sebastian Möller
Corrigendum: Real-time affect detection in virtual reality: A technique based on a three-dimensional model of affect and EEG signals