Yoshihiro Miyake

Prof. Dr. Yoshihiro Miyake


Research Focus & Metrics

Academic Career Length

24Years (2003-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 August 2021 in Sensors
Verified
Journal Article
Open access
PDF file
JQJingyu Quan
Jingyu Quan
YMYoshihiro Miyake
Yoshihiro Miyake
TNTakayuki Nozawa
Takayuki Nozawa
During social interaction, humans recognize others’ emotions via individual features and interpersonal features. However, most previous automatic emotion recognition techniques only used individual features—they have not tested the importance of interpersonal features. In the present study, we asked whether interpersonal features, especially time-lagged synchronization features, are beneficial to the performance of automatic emotion recognition techniques. We explored this question in the main experiment (speaker-dependent emotion recognition) and supplementary experiment (speaker-independent emotion recognition) by building an individual framework and interpersonal framework in visual, audio, and cross-modality, respectively. Our main experiment results showed that the interpersonal framework outperformed the individual framework in every modality. Our supplementary experiment showed—even for unknown communication pairs—that the interpersonal framework led to a better performance. Therefore, we concluded that interpersonal features are useful to boost the performance of automatic emotion recognition tasks. We hope to raise attention to interpersonal features in this study.

11 July 2014 in PLOS ONE
Verified
Journal Article
Open access
PDF file
NHNaoki Higo
Naoki Higo
KOKen-Ichiro Ogawa
Ken-Ichiro Ogawa
JMJuichi Minemura
Juichi Minemura
BXBujie Xu
Bujie Xu
TNTakayuki Nozawa
Takayuki Nozawa
YMYoshihiro Miyake
Yoshihiro Miyake
Individuals are embedded in social networks in which they communicate with others in their daily lives. Because smooth face-to-face communication is the key to maintaining these networks, measuring the smoothness of such communication is an important issue. One indicator of smoothness is the similarity of the body movements of the two individuals concerned. A typical example noted in experimental environments is the interpersonal synchronization of body movements such as nods and gestures during smooth face-to-face communication. It should therefore be possible to estimate quantitatively the smoothness of face-to-face communication in social networks through measurement of the synchronization of body movements. However, this is difficult because social networks, which differ from disciplined experimental environments, are open environments for the face-to-face communication between two individuals. In such open environments, their body movements become complicated by various external factors and may follow unstable and nonuniform patterns. Nevertheless, we consider there to be some interaction during face-to-face communication that leads to the interpersonal synchronization of body movements, which can be seen through the interpersonal similarity of body movements. The present study aims to clarify such interaction in terms of body movements during daily face-to-face communication in real organizations of more than 100 people. We analyzed data on the frequency of body movement for each individual during face-to-face communication, as measured by a wearable sensor, and evaluated the degree of interpersonal similarity of body movements between two individuals as their frequency difference. Furthermore, we generated uncorrelated data by resampling the data gathered and compared these two data sets statistically to distinguish the effects of actual face-to-face communication from those of the activities accompanying the communication. Our results confirm an interpersonal similarity of body movements between two individuals in face-to-face communication, for all the organizations studied, and suggest that some body interaction is behind this similarity.

22 August 2022 in IEEE Access
Verified
Journal Article
Open access
DMDane Anthony Lee Miller
Dane Anthony Lee Miller
OTOgata Taiki
Ogata Taiki
GSGakuto Sasabe
Gakuto Sasabe
LSLiang Shan
Liang Shan
NTNozomi Tsumura
Nozomi Tsumura
YMYoshihiro Miyake
Yoshihiro Miyake
There has been a growing interest in augmented reality (AR) methods for gait guidance and rehabilitation. These methods have been effective in guiding spatial gait parameters, such as stride length, and temporal cycle times when paired with rhythmic stimuli. However, few studies have explored the simultaneous spatial and temporal guidance of gaits and have primarily focused on one of several aspects. Gait parameters are related, and changing one might have unintended effects on others; thus, simultaneous guidance is required. In this study, we designed and evaluated a system that provides simultaneous spatial and temporal guidance using a synchronized walking avatar in AR. The system requires a head-mounted display (HMD) and presents a walking avatar involving auditory cues synchronized with the foot-contact timing of the participant via a mutual entrainment model. Spatial feedback is provided by distance changes between the participant and avatar, and the effects on stride length are observed. Phase difference changes between the avatar and participant serve as temporal cues that are used to guide the cycle time. The stride length and cycle-time of eight participants walking along a straight corridor wearing the HMD were recorded and analyzed. Four experimental conditions were applied comprising combinations of increases and decreases in the spatial and temporal cues. Furthermore, the results demonstrated that spatial and temporal feedback had almost independent effects on respective gait parameters. These findings reveal that this combination of spatiotemporal cueing can be extremely effective in gait guidance without loss of effectiveness from single modality cues.

14 September 2023 in Brain Sciences
Verified
Journal Article
Open access
PDF file
CGChenguang Gao
Chenguang Gao
HUHirotaka Uchitomi
Hirotaka Uchitomi
YMYoshihiro Miyake
Yoshihiro Miyake
Emotion recognition is crucial in understanding human affective states with various applications. Electroencephalography (EEG)—a non-invasive neuroimaging technique that captures brain activity—has gained attention in emotion recognition. However, existing EEG-based emotion recognition systems are limited to specific sensory modalities, hindering their applicability. Our study innovates EEG emotion recognition, offering a comprehensive framework for overcoming sensory-focused limits and cross-sensory challenges. We collected cross-sensory emotion EEG data using multimodal emotion simulations (three sensory modalities: audio/visual/audio-visual with two emotion states: pleasure or unpleasure). The proposed framework—filter bank adversarial domain adaptation Riemann method (FBADR)—leverages filter bank techniques and Riemannian tangent space methods for feature extraction from cross-sensory EEG data. Compared with Riemannian methods, filter bank and adversarial domain adaptation could improve average accuracy by 13.68% and 8.36%, respectively. Comparative analysis of classification results proved that the proposed FBADR framework achieved a state-of-the-art cross-sensory emotion recognition performance and reached an average accuracy of 89.01% ± 5.06%. Moreover, the robustness of the proposed methods could ensure high cross-sensory recognition performance under a signal-to-noise ratio (SNR) ≥ 1 dB. Overall, our study contributes to the EEG-based emotion recognition field by providing a comprehensive framework that overcomes limitations of sensory-oriented approaches and successfully tackles the difficulties of cross-sensory situations.

27 February 2020 in Frontiers in Robotics and AI
Verified
Journal Article
Open access
PDF file
TKTakayuki Kishi
Takayuki Kishi
OTOgata Taiki
Ogata Taiki
HOHiroki Ora
Hiroki Ora
RSRyo Shigeyama
Ryo Shigeyama
MNMasayuki Nakayama
Masayuki Nakayama
YMYoshihiro Miyake
Yoshihiro Miyake
This study aimed to investigate whether using a wearable robot applying interactive rhythmic stimulation on the upper limbs of patients with Parkinson's disease (PD) could affect their gait. The wearable robot presented tactile stimuli on the patients' upper limbs, which was mutually synchronized with the swing of their upper limbs. We conducted an evaluation experiment with PD patients (n = 30, Modified Hoehn-Yahr = 1–3, on-state) to investigate the assistance effect by the robot and the immediate after-effect of intervention. The participants were instructed to walk 30 m under four different conditions: (1) not wearing the robot before the intervention (Pre-condition), (2) wearing the robot without the rhythm assistance (RwoA condition), (3) wearing the robot with rhythm assistance (RwA condition), and (4) not wearing the robot immediately after the intervention (Post-condition). These conditions were conducted in this order over a single day. The third condition was performed three times and the others, once. The arm swing amplitude, stride length, and velocity were increased in the RwA condition compared to the RwoA condition. The coefficient of variance (CV) of the stride duration was decreased in the RwA condition compared to the RwoA condition. These results revealed that the assistance by the robot increased the gait performance of PD patients. In addition, the stride length and velocity were increased and the stride duration CV was decreased in the Post-condition compared to the Pre-condition. These results show that the effect of robot assistance on the patient's gait remained immediately after the intervention. These findings suggest that synchronized rhythmic stimulation on the upper limbs could influence the gait of PD patients and that the robot may assist with gait rehabilitation in these patients.

16 May 2023 in Sensors
Verified
Journal Article
Open access
PDF file
CGChenguang Gao
Chenguang Gao
HUHirotaka Uchitomi
Hirotaka Uchitomi
YMYoshihiro Miyake
Yoshihiro Miyake
This study aimed to reveal the influence of emotional valence and sensory modality on neural activity in response to multimodal emotional stimuli using scalp EEG. In this study, 20 healthy participants completed the emotional multimodal stimulation experiment for three stimulus modalities (audio, visual, and audio-visual), all of which are from the same video source with two emotional components (pleasure or unpleasure), and EEG data were collected using six experimental conditions and one resting state. We analyzed power spectral density (PSD) and event-related potential (ERP) components in response to multimodal emotional stimuli, for spectral and temporal analysis. PSD results showed that the single modality (audio only/visual only) emotional stimulation PSD differed from multi-modality (audio-visual) in a wide brain and band range due to the changes in modality and not from the changes in emotional degree. The most pronounced N200-to-P300 potential shifts occurred in monomodal rather than multimodal emotional stimulations. This study suggests that emotional saliency and sensory processing efficiency perform a significant role in shaping neural activity during multimodal emotional stimulation, with the sensory modality being more influential in PSD. These findings contribute to our understanding of the neural mechanisms involved in multimodal emotional stimulation.