Takashi Shibuya

Takashi Shibuya

Auto-generated profile, based on publicly available information

Takashi Shibuya

Sony AI, Tokyo, Japan

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 August 2023
Verified
Conference Paper
Open access
RSRyosuke Sawata
Ryosuke Sawata
NMNaoki Murata
Naoki Murata
YTYuhta Takida
Yuhta Takida
TUToshimitsu Uesaka
Toshimitsu Uesaka
TSTakashi Shibuya
Takashi Shibuya
YMYuki Mitsufuji
Yuki Mitsufuji

1 October 2006
Verified
Conference Paper
Closed access
THTomoki Hamagami
Tomoki Hamagami
TSTakashi Shibuya
Takashi Shibuya
SSShingo Shimada
Shingo Shimada
A new reinforcement learning algorithm with complex-valued functions is proposed. The algorithm is inspired by complex-valued neural networks introducing complex numbers representing phase and amplitude into a conventional neural network. The strong advantage of using complex values in reinforcement learning is that the state-action function in a time series can be easily extended. In particular, considering the coherence of each complex value, the proposed learning algorithm can represent the context of agent behavior. This extension allows compensating for the perceptual aliasing problem and provides for the intelligent behavior of mobile robots in the real world. The complex-valued functions are applied to the conventional reinforcement learning algorithms: Q-learning and profit sharing. These algorithms are evaluated by simple maze problems and a bar-carrying task involving perceptual aliasings. Simulation experiments show that the new algorithm can efficiently solve perceptual aliasing.

27 October 2025
Verified
Conference Paper
Open access
YCYuanhong Chen
Yuanhong Chen
KSKazuki Shimada
Kazuki Shimada
CSChristian Simon
Christian Simon
YIYukara Ikemiya
Yukara Ikemiya
TSTakashi Shibuya
Takashi Shibuya
YMYuki Mitsufuji
Yuki Mitsufuji

10 July 2025 in IEEE Transactions on Audio, Speech and Language Processing
Verified
Journal Article
Open access
KSKazuki Shimada
Kazuki Shimada
KUKengo Uchida
Kengo Uchida
YKYuichiro Koyama
Yuichiro Koyama
TSTakashi Shibuya
Takashi Shibuya
STShusuke Takahashi
Shusuke Takahashi
TKTatsuya Kawahara
Tatsuya Kawahara
We aim for an open-vocabulary sound event localization and detection (SELD) system that detects and localizes sound events in any category described by prompt texts. An open-vocabulary SELD system can be applied to various SELD tasks by changing prompt texts. A simple approach is to combine a language-audio model, such as a contrastive language-audio pretraining (CLAP) model, and a direction-of-arrival (DOA) estimation model. However, this combining approach cannot tackle overlapping sound events because the language-audio models output only one audio embedding, even for an audio input containing multiple events. Also, such a naive combination of two models can be sub-optimal regarding joint localization and detection. In this study, we present an embed-ACCDOA model, which jointly learns to output an embedding and the corresponding activity-coupled Cartesian DOA (ACCDOA) vector of each event in a track-wise manner, thereby tackling overlapping events. Each event's embedding is trained to align with its corresponding audio and text embeddings inferred by a pretrained language-audio model, distilling its knowledge into the embed-ACCDOA model. We evaluate the proposed embed-ACCDOA model using an original synthetic dataset and two external SELD datasets. The knowledge distillation using both audio and text embeddings performs better than distillation using only one of the embeddings. The embed-ACCDOA model outperforms the naive combination. Moreover, it performs better than the official baseline system trained on the fully annotated training data of the target categories. The code will be released.

11 September 2026
Verified
Book Chapter
Closed access
PDF file
AHAkio Hayakawa
Akio Hayakawa
MIMasato Ishii
Masato Ishii
TSTakashi Shibuya
Takashi Shibuya
YMYuki Mitsufuji
Yuki Mitsufuji