Masafumi Nishida

Prof. Masafumi Nishida


Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 June 2024 in Applied Sciences
Verified
Journal Article
Open access
PDF file
MMMaliha Binte Mamun
Maliha Binte Mamun
TTTakashi Tsunakawa
Takashi Tsunakawa
MNMasafumi Nishida
Masafumi Nishida
MNMasafumi Nishimura
Masafumi Nishimura
The growing number of social media users has impacted the rise in hate comments and posts. While extensive research in hate speech detection attempts to combat this phenomenon by developing new datasets and detection models, reconciling classification accuracy with broader decision-making metrics like plausibility and faithfulness remains challenging. As restrictions on social media tighten to stop the spread of hate and offensive content, users have adapted by finding new approaches, often camouflaged in the form of sarcasm. Therefore, dealing with new trends such as the increased use of emoticons (negative emoticons in positive sentences) and sarcastic comments is necessary. This paper introduces sarcasm-based rationale (emoticons or portions of text that indicate sarcasm) combined with hate/offensive rationale for better detection of hidden hate comments/posts. A dataset was created by labeling texts and selecting rationale based on sarcasm from the existing benchmark hate dataset, HateXplain. The newly formed dataset was then applied in the existing state-of-the-art model. The model’s F1-score increased by 0.01 when using sarcasm rationale with hate/offensive rationale in a newly formed attention proposed in the data’s preprocessing step. Also, with the new data, a significant improvement was observed in explainability metrics such as plausibility and faithfulness.

25 August 2025 in Sensors
Verified
Journal Article
Open access
PDF file
Long Hoang PhamLong Hoang Pham
Long Hoang Pham
HTHibiki Takayama
Hibiki Takayama
MNMasafumi Nishida
Masafumi Nishida
STSatoru Tsuge
Satoru Tsuge
SKShingo Kuroiwa
Shingo Kuroiwa
Biometric authentication using human physiological and behavioral characteristics has been widely adopted, with speaker verification attracting attention due to its convenience and noncontact nature. Conventional speaker verification systems remain vulnerable to spoofing attacks, however, often requiring integration with separate spoofed speech detection models. In this work, the authors propose an emotion-dependent speaker verification system that integrates speaker characteristics with emotional speech characteristics, enhancing robustness against spoofed speech without relying on additional classification models. By comparing acoustic characteristics of emotions between registered and verification speech using pretrained models, the proposed method reduces the equal error rate compared to conventional speaker verification systems, achieving an average equal error rate of 1.13% for speaker verification and 17.7% for the anti-spoofing task. Researchers additionally conducted a user evaluation experiment to assess the usability of emotion-dependent speaker verification. The results indicate that although emotion-dependent authentication was initially cognitively stressful, participants adapted over time, and the burden was significantly reduced after three sessions. Among the tested emotions (anger, joy, sadness, and neutral), sadness proved most effective, with stable scores, a low error rate, and minimal user strain. These findings suggest that neutral speech is not always the optimal choice for speaker verification and that well-designed emotion-dependent authentication can offer a practical and robust security solution.

2 March 2025 in Sensors
Verified
Journal Article
Open access
PDF file
TTTsukagoshi Toshihiro
Tsukagoshi Toshihiro
MNMasafumi Nishida
Masafumi Nishida
MNMasafumi Nishimura
Masafumi Nishimura
Speaking and eating are essential components of health management. To enable the daily monitoring of these behaviors, systems capable of simultaneously recognizing speech and eating behaviors are required. However, due to the distinct acoustic and contextual characteristics of these two domains, achieving high-precision integrated recognition remains underexplored. In this study, we propose a method that combines data augmentation through synthetic data creation with a two-stage fine-tuning approach tailored to the complexity of domain adaptation. By concatenating speech and eating sounds of varying lengths and sequences, we generated training data that mimic real-world environments where speech and eating behaviors co-exist. Additionally, efficient model adaptation was achieved through two-stage fine-tuning of the self-supervised learning model. The experimental evaluations demonstrate that the proposed method maintains speech recognition accuracy while achieving high detection performance for eating behaviors, with an F1 score of 0.918 for chewing detection and 0.926 for swallowing detection. These results underscore the potential of using voice recognition technology for daily health monitoring.

20 January 2020 in Journal of Signal Processing
Verified
Journal Article
Open access
PDF file
SLShengke Lin
Shengke Lin
TTTakashi Tsunakawa
Takashi Tsunakawa
MNMasafumi Nishida
Masafumi Nishida
In this paper, we propose a method to improve a recognition performance of multiparty conversations by using both close-talk and throat microphones. Throat microphone is robust against external noise. However, its characteristics are much different from those of conventional acoustic microphone such as close-talk. Therefore, it is generally not suitable for a speech recognition because of acoustic mismatch between them. We tried to map a spectra of throat microphone to close-talk and estimate a clean speech by controlling weights of speech of each microphone. The proposed method was able to improve a performance of large vocabulary continuous speech recognition task for data on which utterance was superimposed manually and group discussion.