Kazuki Shimada

Kazuki Shimada

Auto-generated profile, based on publicly available information

Kazuki Shimada

Graduate School of Informatics, Kyoto University, Kyoto, Japan

Research Focus & Metrics

Academic Career Length

30Years (1997-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 March 2019 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Open access
KSKazuki Shimada
Kazuki Shimada
YBYoshiaki Bando
Yoshiaki Bando
MMMasato Mimura
Masato Mimura
KIKatsutoshi Itoyama
Katsutoshi Itoyama
KYKazuyoshi Yoshii
Kazuyoshi Yoshii
TKTatsuya Kawahara
Tatsuya Kawahara
This paper describes multichannel speech enhancement for improving automatic speech recognition (ASR) in noisy environments. Recently, the minimum variance distortionless response (MVDR) beamforming has widely been used because it works well if the steering vector of speech and the spatial covariance matrix (SCM) of noise are given. To estimating such spatial information, conventional studies take a supervised approach that classifies each time-frequency (TF) bin into noise or speech by training a deep neural network (DNN). The performance of ASR, however, is degraded in an unknown noisy environment. To solve this problem, we take an unsupervised approach that decomposes each TF bin into the sum of speech and noise by using multichannel nonnegative matrix factorization (MNMF). This enables us to accurately estimate the SCMs of speech and noise not from observed noisy mixtures but from separated speech and noise components. In this paper we propose online MVDR beamforming by effectively zing and incrementally updating the parameters of MNMF. Another main contribution is to comprehensively investigate the performances of ASR obtained by various types of spatial filters, i.e., time-invariant and variant versions of MVDR beamformers and those of rank-1 and full-rank multichannel Wiener filters, in combination with MNMF. The experimental results showed that the proposed method outperformed the state-of-the-art DNN-based beamforming method in unknown environments that did not match training data.

1 April 2018
Verified
Conference Paper
Closed access
KSKazuki Shimada
Kazuki Shimada
YBYoshiaki Bando
Yoshiaki Bando
MMMasato Mimura
Masato Mimura
KIKatsutoshi Itoyama
Katsutoshi Itoyama
KYKazuyoshi Yoshii
Kazuyoshi Yoshii
TKTatsuya Kawahara
Tatsuya Kawahara
This paper presents unsupervised multichannel speech enhancement for noisy speech recognition. Time-frequency (TF) mask estimation has actively been studied for estimating the steering vectors and spatial covariance matrices of speech and noise used for beamforming. The state-of-the-art approach to mask estimation is to use deep neural networks (DNN s) for classifying the TF bins of observed signals into speech and noise. Such a supervised approach, however, does not work well in an unknown environment. To accurately estimate the spatial covariance matrices in an unsupervised manner, we perform blind source separation (BSS) based on multichannel nonnegative matrix factorization (MNMF) for decomposing each TF bin into the components of speech and the other sources (noise). To clarify a suitable type of beamforming for MNMF, we tested both time- invariant and time-varying versions of the minimum variance distortionless response (MVDR) beamforming in addition to standard multichannel Wiener filtering (MWF). The experimental results showed that our MNMF-based beamforming approach outperformed the state-of-the-art DNN-based beamforming method in unknown environments that do not match the training data.


27 October 2025
Verified
Conference Paper
Open access
YCYuanhong Chen
Yuanhong Chen
KSKazuki Shimada
Kazuki Shimada
CSChristian Simon
Christian Simon
YIYukara Ikemiya
Yukara Ikemiya
TSTakashi Shibuya
Takashi Shibuya
YMYuki Mitsufuji
Yuki Mitsufuji

20 August 2017
Verified
Conference Paper
Closed access
MMMasato Mimura
Masato Mimura
YBYoshiaki Bando
Yoshiaki Bando
KSKazuki Shimada
Kazuki Shimada
SSShinsuke Sakai
Shinsuke Sakai
KYKazuyoshi Yoshii
Kazuyoshi Yoshii
TKTatsuya Kawahara
Tatsuya Kawahara

10 July 2025 in IEEE Transactions on Audio, Speech and Language Processing
Verified
Journal Article
Open access
KSKazuki Shimada
Kazuki Shimada
KUKengo Uchida
Kengo Uchida
YKYuichiro Koyama
Yuichiro Koyama
TSTakashi Shibuya
Takashi Shibuya
STShusuke Takahashi
Shusuke Takahashi
TKTatsuya Kawahara
Tatsuya Kawahara
We aim for an open-vocabulary sound event localization and detection (SELD) system that detects and localizes sound events in any category described by prompt texts. An open-vocabulary SELD system can be applied to various SELD tasks by changing prompt texts. A simple approach is to combine a language-audio model, such as a contrastive language-audio pretraining (CLAP) model, and a direction-of-arrival (DOA) estimation model. However, this combining approach cannot tackle overlapping sound events because the language-audio models output only one audio embedding, even for an audio input containing multiple events. Also, such a naive combination of two models can be sub-optimal regarding joint localization and detection. In this study, we present an embed-ACCDOA model, which jointly learns to output an embedding and the corresponding activity-coupled Cartesian DOA (ACCDOA) vector of each event in a track-wise manner, thereby tackling overlapping events. Each event's embedding is trained to align with its corresponding audio and text embeddings inferred by a pretrained language-audio model, distilling its knowledge into the embed-ACCDOA model. We evaluate the proposed embed-ACCDOA model using an original synthetic dataset and two external SELD datasets. The knowledge distillation using both audio and text embeddings performs better than distillation using only one of the embeddings. The embed-ACCDOA model outperforms the naive combination. Moreover, it performs better than the official baseline system trained on the fully annotated training data of the target categories. The code will be released.