Tatsuya Kawahara

Tatsuya Kawahara

Auto-generated profile, based on publicly available information

Tatsuya Kawahara

Graduate School of Informatics, Kyoto University, Kyoto, Japan

Research Focus & Metrics

Academic Career Length

36Years (1991-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 August 2016
Verified
Conference Paper
Closed access
DGDylan Glas
Dylan Glas
TMTakashi Minato
Takashi Minato
CICarlos T. Ishi
Carlos T. Ishi
TKTatsuya Kawahara
Tatsuya Kawahara
HIHiroshi Ishiguro
Hiroshi Ishiguro
The development of an android with convincingly lifelike appearance and behavior has been a long-standing goal in robotics, and recent years have seen great progress in many of the technologies needed to create such androids. However, it is necessary to actually integrate these technologies into a robot system in order to assess the progress that has been made towards this goal and to identify important areas for future work. To this end, we are developing ERICA, an autonomous android system capable of conversational interaction, featuring advanced sensing and speech synthesis technologies, and arguably the most humanlike android built to date. Although the project is ongoing, initial development of the basic android platform has been completed. In this paper we present an overview of the requirements and design of the platform, describe the development process of an interactive application, report on ERICA's first autonomous public demonstration, and discuss the main technical challenges that remain to be addressed in order to create humanlike, autonomous androids.

25 March 2019 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Open access
KSKazuki Shimada
Kazuki Shimada
YBYoshiaki Bando
Yoshiaki Bando
MMMasato Mimura
Masato Mimura
KIKatsutoshi Itoyama
Katsutoshi Itoyama
KYKazuyoshi Yoshii
Kazuyoshi Yoshii
TKTatsuya Kawahara
Tatsuya Kawahara
This paper describes multichannel speech enhancement for improving automatic speech recognition (ASR) in noisy environments. Recently, the minimum variance distortionless response (MVDR) beamforming has widely been used because it works well if the steering vector of speech and the spatial covariance matrix (SCM) of noise are given. To estimating such spatial information, conventional studies take a supervised approach that classifies each time-frequency (TF) bin into noise or speech by training a deep neural network (DNN). The performance of ASR, however, is degraded in an unknown noisy environment. To solve this problem, we take an unsupervised approach that decomposes each TF bin into the sum of speech and noise by using multichannel nonnegative matrix factorization (MNMF). This enables us to accurately estimate the SCMs of speech and noise not from observed noisy mixtures but from separated speech and noise components. In this paper we propose online MVDR beamforming by effectively zing and incrementally updating the parameters of MNMF. Another main contribution is to comprehensively investigate the performances of ASR obtained by various types of spatial filters, i.e., time-invariant and variant versions of MVDR beamformers and those of rank-1 and full-rank multichannel Wiener filters, in combination with MNMF. The experimental results showed that the proposed method outperformed the state-of-the-art DNN-based beamforming method in unknown environments that did not match training data.

25 August 2020 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Open access
KSKouhei Sekiguchi
Kouhei Sekiguchi
YBYoshiaki Bando
Yoshiaki Bando
ANAditya Arie Nugraha
Aditya Arie Nugraha
KYKazuyoshi Yoshii
Kazuyoshi Yoshii
TKTatsuya Kawahara
Tatsuya Kawahara
This paper describes a computationally-efficient blind source separation (BSS) method based on the independence, low-rankness, and directivity of the sources. A typical approach to BSS is unsupervised learning of a probabilistic model that consists of a source model representing the time-frequency structure of source images and a spatial model representing their inter-channel covariance structure. Building upon the low-rank source model based on nonnegative matrix factorization (NMF), which has been considered to be effective for inter-frequency source alignment, multichannel NMF (MNMF) assumes source images to follow multivariate complex Gaussian distributions with unconstrained full-rank spatial covariance matrices (SCMs). An effective way of reducing the computational cost and initialization sensitivity of MNMF is to restrict the degree of freedom of SCMs. While a variant of MNMF called independent low-rank matrix analysis (ILRMA) severely restricts SCMs to rank-1 matrices under an idealized condition that only directional and less-echoic sources exist, we restrict SCMs to jointly-diagonalizable yet full-rank matrices in a frequency-wise manner, resulting in FastMNMF1. To help inter-frequency source alignment, we then propose FastMNMF2 that shares the directional feature of each source over all frequency bins. To explicitly consider the directivity or diffuseness of each source, we also propose rank-constrained FastMNMF that enables us to individually specify the ranks of SCMs. Our experiments showed the superiority of FastMNMF over MNMF and ILRMA in speech separation and the effectiveness of the rank constraint in speech enhancement.

8 September 2016
Verified
Conference Paper
Closed access
TKTatsuya Kawahara
Tatsuya Kawahara
TYTakashi Yamaguchi
Takashi Yamaguchi
KIKoji Inoue
Koji Inoue
KTKatsuya Takanashi
Katsuya Takanashi
NWNigel Ward
Nigel Ward

7 October 2019 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Open access
KSKouhei Sekiguchi
Kouhei Sekiguchi
YBYoshiaki Bando
Yoshiaki Bando
ANAditya Arie Nugraha
Aditya Arie Nugraha
KYKazuyoshi Yoshii
Kazuyoshi Yoshii
TKTatsuya Kawahara
Tatsuya Kawahara
This paper describes a semi-supervised multichannel speech enhancement method that only uses clean speech data for prior training. Although multichannel nonnegative matrix factorization (MNMF) and its constrained variant called independent low-rank matrix analysis (ILRMA) have successfully been used for unsupervised speech enhancement, the low-rank assumption on the power spectral densities (PSDs) of all sources (speech and noise) does not hold in reality. To solve this problem, we replace a low-rank model of speech with a deep generative model in the framework of MNMF or ILRMA, i.e., formulate a probabilistic model of noisy speech by integrating a deep speech model, a low-rank noise model, and a full-rank or rank-1 model of spatial characteristics of speech and noise. The deep speech model is trained from clean speech data in an unsupervised auto-encoding variational Bayesian manner. Given multichannel noisy speech spectra, the full-rank or rank-1 spatial covariance matrices and PSDs of speech and noise are estimated in an unsupervised maximum-likelihood manner. Experimental results showed that the full-rank version of the proposed method was significantly better than MNMF, ILRMA, and the rank-1 version. We confirmed that the initialization-sensitivity and local-optimum problems of MNMF with many spatial parameters can be solved by incorporating the precise speech model.

1 January 1998 in IEEE Transactions on Speech and Audio Processing
Verified
Journal Article
Closed access
TKT. Kawahara
T. Kawahara
CLChin-Hui Lee
Chin-Hui Lee
BJBiing-Hwang Juang
Biing-Hwang Juang