Jingyu Quan

Mr. Jingyu Quan


Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 August 2021 in Sensors
Verified
Journal Article
Open access
PDF file
JQJingyu Quan
Jingyu Quan
YMYoshihiro Miyake
Yoshihiro Miyake
TNTakayuki Nozawa
Takayuki Nozawa
During social interaction, humans recognize others’ emotions via individual features and interpersonal features. However, most previous automatic emotion recognition techniques only used individual features—they have not tested the importance of interpersonal features. In the present study, we asked whether interpersonal features, especially time-lagged synchronization features, are beneficial to the performance of automatic emotion recognition techniques. We explored this question in the main experiment (speaker-dependent emotion recognition) and supplementary experiment (speaker-independent emotion recognition) by building an individual framework and interpersonal framework in visual, audio, and cross-modality, respectively. Our main experiment results showed that the interpersonal framework outperformed the individual framework in every modality. Our supplementary experiment showed—even for unknown communication pairs—that the interpersonal framework led to a better performance. Therefore, we concluded that interpersonal features are useful to boost the performance of automatic emotion recognition tasks. We hope to raise attention to interpersonal features in this study.

8 February 2024 in IEEE Transactions on Affective Computing
Verified
Journal Article
Open access
SHSarinasadat Hosseini
Sarinasadat Hosseini
JQJingyu Quan
Jingyu Quan
XDXiaoqi Deng
Xiaoqi Deng
YMYoshihiro Miyake
Yoshihiro Miyake
TNTakayuki Nozawa
Takayuki Nozawa
This study examined the use of avatars to provide feedback to influence action identities, anxiety, mood, and performance during job interview training. We recruited 36 university students for the experiment and divided them into two groups. The first group received avatar-based feedback whereas the other group received self-feedback after the first interview session. Results showed that the avatar-based feedback group experienced significantly higher levels of action identities, reduced anxiety, and happier mood in the second interview after the feedback session. Additionally, compared to the self-feedback group, the avatar-based feedback group rated their performance better in the second interview. Furthermore, the effect of avatar feedback on mood and performance varied depending on the participants' initial anxiety levels. For those with low initial anxiety, avatar feedback resulted in higher levels of action identification, a marginally significant increase in positive mood, higher pitch, better word usage, and better self-assessment. In contrast, for those with high initial anxiety, avatar feedback did not cause any significant changes in the action identities or moods, however, it reduced anxiety and the use of weak words. We believe that our findings have implications not only for improving job interview performance but also for designing future communication coaching systems.

13 January 2025 in Sensors
Verified
Journal Article
Open access
PDF file
JQJingyu Quan
Jingyu Quan
YMYoshihiro Miyake
Yoshihiro Miyake
TNTakayuki Nozawa
Takayuki Nozawa
This study investigates how interpersonal (speaker–partner) synchrony contributes to empathetic response generation in communication scenarios. To perform this investigation, we propose a model that incorporates multimodal directional (positive and negative) interpersonal synchrony, operationalized using the cosine similarity measure, into empathetic response generation. We evaluate how incorporating specific synchrony affects the generated responses at the language and empathy levels. Based on comparison experiments, models with multimodal synchrony generate responses that are closer to ground truth responses and more diverse than models without synchrony. This demonstrates that these features are successfully integrated into the models. Additionally, we find that positive synchrony is linked to enhanced emotional reactions, reduced exploration, and improved interpretation. Negative synchrony is associated with reduced exploration and increased interpretation. These findings shed light on the connections between multimodal directional interpersonal synchrony and empathy’s emotional and cognitive aspects in artificial intelligence applications.