Jun Baba

Jun Baba

Auto-generated profile, based on publicly available information

Jun Baba

CyberAgent, Tokyo, Japan

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 December 2021 in Frontiers in Robotics and AI
Verified
Journal Article
Open access
JBJun Baba
Jun Baba
SSSichao Song
Sichao Song
JNJunya Nakanishi
Junya Nakanishi
YYYuichiro Yoshikawa
Yuichiro Yoshikawa
HIHiroshi Ishiguro
Hiroshi Ishiguro
In recent years, the demand for remote services has increased with concerns regarding the spread of infectious diseases and employees’ quality of life. Many attempts have been made to enable store staff to provide various services remotely via avatars displayed to on-site customers. However, the workload required on the part of service staff by the emerging new work style of operating avatar robots remains a concern. No study has compared the performance and perceived workload of the same staff working locally versus remotely via an avatar. In this study, we conducted an experiment to identify differences between the performance of in-person services and remote work through an avatar robot in an actual public space. The results showed that there were significant differences in the partial performance between working via an avatar and working locally, and we could not find significant difference in the overall performance. On the other hand, the perceived workload was significantly lower when the avatar robot was used. We also found that customers reacted differently to the robots and to the in-person participants. In addition, the workload perceived by operators in the robotic task was correlated with their personality and experience. To the best of our knowledge, this study is the first investigation of both performance and workload in remote customer service through robotic avatars, and it has important implications for the implementation of avatar robots in service settings.

7 July 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Open access
TITakuya Iwamoto
Takuya Iwamoto
JBJun Baba
Jun Baba
JNJunya Nakanishi
Junya Nakanishi
KHKatsuya Hyodo
Katsuya Hyodo
YYYuichiro Yoshikawa
Yuichiro Yoshikawa
Hiroshi IshiguroHiroshi Ishiguro
Hiroshi Ishiguro
Successful cases of robot sales promotions have been increasing. Users tend to make purchases when robots properly interact with users. Most robot interactions/recommendations are created using specific products and locations within the context. Therefore, developers have to prepare a new recommendation interaction each time with each new product, which creates difficulty in responding smoothly to store’s requests. In this study, we propose Playful Recommendation, which is a situation-independent sales promotion method. This method stimulates pleasant emotions instead of presenting product information to the user, and the proposed method is less product-and location-dependent than other methods. Playful Recommendation was effective in two fieldworks. In both cases, the Playful Recommendation by the robot resulted in higher sales than the normal condition. Furthermore we have shown that the proposed method can be applied to a variety of robots and has the possibility of promoting products even when the recommended products change.

1 July 2018
Verified
Conference Paper
Open access
TMTakanori Maehara
Takanori Maehara
ANAtsuhiro Narita
Atsuhiro Narita
JBJun Baba
Jun Baba
TKTakayuki Kawabata
Takayuki Kawabata
Electronic proceedings of IJCAI 2018

14 July 2022 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Open access
Zhaojie LuoZhaojie Luo
Zhaojie Luo
SLShoufeng Lin
Shoufeng Lin
Rui LiuRui Liu
Rui Liu
JBJun Baba
Jun Baba
YYYuichiro Yoshikawa
Yuichiro Yoshikawa
HIHiroshi Ishiguro
Hiroshi Ishiguro
Emotional voice conversion (VC) aims to convert a neutral voice to an emotional one while retaining the linguistic information and speaker identity. We note that the decoupling of emotional features from other speech information (such as content, speaker identity, etc.) is the key to achieving promising performance. Some recent attempts of speech representation decoupling on the neutral speech cannot work well on the emotional speech, due to the more complex entanglement of acoustic properties in the latter. To address this problem, here we propose a novel Source-Filter-based Emotional VC model (SFEVC) to achieve proper filtering of speaker-independent emotion cues from both the timbre and pitch features. Our SFEVC model consists of multi-channel encoders, emotion separate encoders, pre-trained speaker-dependent encoders, and the corresponding decoder. Note that all encoder modules adopt a designed information bottleneck auto-encoder. Additionally, to further improve the conversion quality for various emotions, a novel training strategy based on the 2D Valence-Arousal (VA) space is proposed. Experimental results show that the proposed SFEVC along with a VA training strategy outperforms all baselines and achieves the state-of-the-art performance in speaker-independent emotional VC with nonparallel data.

13 March 2023
Verified
Conference Paper
Open access
SSSichao Song
Sichao Song
JBJun Baba
Jun Baba
YOYuki Okafuji
Yuki Okafuji
JNJunya Nakanishi
Junya Nakanishi
YYYuichiro Yoshikawa
Yuichiro Yoshikawa
Hiroshi IshiguroHiroshi Ishiguro
Hiroshi Ishiguro
Service robots have increasingly been investigated in retailing. Previous studies mainly focused on the effectiveness of recommendation with regard to a single robot, and whether and how the use of two robots combined can achieve better performance remain unclear. In this study, we address this by exploring the combination power of two service robots for product recommendation in a bakery. We placed one robot inside the store for product recommendation and the other robot outside to promote the inside robot. Particularly, we are interested in the effects of the outside robot on the inside robot's performance in product recommendation. Our results indicate that using the outside robot to promote the inside robot achieved more purchases over using the inside robot alone. Particularly, we discovered that the outside robot increased the attention of customers toward the inside robot; hence, more customers checked and purchased the products. Based on the findings, we discuss the important points for the effective use of service robots.

11 May 2024
Verified
Conference Paper
Open access
NONami Ogawa
Nami Ogawa
JBJun Baba
Jun Baba
JNJunya Nakanishi
Junya Nakanishi
Teleoperating social robots requires operators to “speak as the robot,” as local users would favor robots whose appearance and voice match. This study focuses on real-time altered auditory feedback (AAF), a method to transform the acoustic traits of one’s speech and provide feedback to the speaker, to transform the operator’s self-representation toward “becoming the robot.” To explore whether AAF with voice transformation (VT) matched to the robot’s appearance can influence the operator’s self-representation and ease the task, we experimented with three conditions: no VT (No-VT), only VT (VT-only), and VT with AAF (VT-AAF), where participants teleoperated a robot to verbally serve real passersby at a bakery. The questionnaire results demonstrate that VT-AAF changed the participants’ self-representation to match the robot’s character and improved participants’ subjective teleoperating experience, while task performance and implicit measures of self-representation were not significantly affected. Notably, 87% of the participants preferred VT-AAF the most.