Koji Yamamoto

Koji Yamamoto

Auto-generated profile, based on publicly available information

Koji Yamamoto

Faculty of Information and Human Sciences, Kyoto Institute of Technology, Kyoto, Japan

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
31 March 2021 in IEEE Transactions on Mobile Computing
Verified
Journal Article
Open access
SISohei Itahara
Sohei Itahara
TNTakayuki Nishio
Takayuki Nishio
YKYusuke Koda
Yusuke Koda
MMMasahiro Morikura
Masahiro Morikura
KYKoji Yamamoto
Koji Yamamoto
This study develops a federated learning (FL) framework overcoming largely incremental communication costs due to model sizes in typical frameworks without compromising model performance. To this end, based on the idea of leveraging an unlabeled open dataset, we propose a distillation-based semi-supervised FL (DS-FL) algorithm that exchanges the outputs of local models among mobile devices, instead of model parameter exchange employed by the typical frameworks. In DS-FL, the communication cost depends only on the output dimensions of the models and does not scale up according to the model size. The exchanged model outputs are used to label each sample of the open dataset, which creates an additionally labeled dataset. Based on the new dataset, local models are further trained, and model performance is enhanced owing to the data augmentation effect. We further highlight that in DS-FL, the heterogeneity of the devices’ dataset leads to ambiguous of each data sample and lowing of the training convergence. To prevent this, we propose entropy reduction averaging, where the aggregated model outputs are intentionally sharpened. Moreover, extensive experiments show that DS-FL reduces communication costs up to 99 percent relative to those of the FL benchmark while achieving similar or higher classification accuracy.

8 August 2019 in IEEE Journal on Selected Areas in Communications
Verified
Journal Article
Closed access
TNTakayuki Nishio
Takayuki Nishio
HOHironao Okamoto
Hironao Okamoto
KNKota Nakashima
Kota Nakashima
YKYusuke Koda
Yusuke Koda
KYKoji Yamamoto
Koji Yamamoto
RMRyo Miyatake
Ryo Miyatake
This study demonstrates the feasibility of proactive received power prediction by leveraging spatiotemporal visual sensing information towards reliable millimeter-wave (mmWave) networks. As the received power on a mmWave link can attenuate aperiodically owing to human blockages, a long-term series of the future received power cannot be predicted by analyzing the received signals prior to the blockage occurring. We propose a novel mechanism that predicts the time series of received power from the next moment to as many as several hundred milliseconds ahead. The key idea is to leverage camera imagery and machine learning (ML). Time-sequential images may involve the spatial geometry and mobility of obstacles representing mmWave signal propagation. ML is used to construct a prediction model from a dataset of sequential images labeled with received power in several hundred milliseconds ahead of the time at which each image is obtained. The simulation and experimental evaluations conducted using IEEE 802.11ad devices and a depth camera demonstrated that the proposed mechanism employing convolutional long short-term memory predicted a time series of received power up to 500 ms ahead, with an inference time of less than 3 ms and a root-mean-square error of 3.4 dB.

24 December 2019 in IEEE Transactions on Cognitive Communications and Networking
Verified
Journal Article
Open access
YKYusuke Koda
Yusuke Koda
KNKota Nakashima
Kota Nakashima
KYKoji Yamamoto
Koji Yamamoto
TNTakayuki Nishio
Takayuki Nishio
MMMasahiro Morikura
Masahiro Morikura
For millimeter-wave networks, this paper presents a paradigm shift for leveraging time-consecutive camera images in handover decision problems. While making handover decisions, it is important to predict future long-term performance—e.g., the cumulative sum of time-varying data rates—proactively to avoid making myopic decisions. However, this study experimentally notices that a time-variation in the received powers is not necessarily informative for proactively predicting the rapid degradation of data rates caused by moving obstacles. To overcome this challenge, this study proposes a proactive framework wherein handover timings are optimized while obstacle-caused data rate degradations are predicted before the degradations occur. The key idea is to expand a state space to involve time-consecutive camera images, which comprises informative features for predicting such data rate degradations. To overcome the difficulty in handling the large dimensionality of the expanded state space, we use a deep reinforcement learning for deciding the handover timings. The evaluations performed based on the experimentally obtained camera images and received powers demonstrate that the expanded state space facilitates (i) the prediction of obstacle-caused data rate degradations from 500 ms before the degradations occur and (ii) superior performance to a handover framework without the state space expansion.

6 March 2020 in IEEE Communications Letters
Verified
Journal Article
Closed access
YKYusuke Koda
Yusuke Koda
JPJihong Park
Jihong Park
MBMehdi Bennis
Mehdi Bennis
KYKoji Yamamoto
Koji Yamamoto
TNTakayuki Nishio
Takayuki Nishio
KNKota Nakashima
Kota Nakashima
The goal of this study is to improve the accuracy of millimeter wave received power prediction by utilizing camera images and radio frequency (RF) signals, while gathering image inputs in a communication-efficient and privacy-preserving manner. To this end, we propose a distributed multimodal machine learning (ML) framework, coined multimodal split learning (MultSL), in which a large neural network (NN) is split into two wirelessly connected segments. The upper segment combines images and received powers for future received power prediction, whereas the lower segment extracts features from camera images and compresses its output to reduce communication costs and privacy leakage. Experimental evaluation corroborates that MultSL achieves higher accuracy than the baselines utilizing either images or RF signals. Remarkably, without compromising accuracy, compressing the lower segment output by 16x yields 16x lower communication latency and 2.8% less privacy leakage compared to the case without compression.

11 February 2020 in IEEE Access
Verified
Journal Article
Open access
KNKota Nakashima
Kota Nakashima
SKShotaro Kamiya
Shotaro Kamiya
KOKazuki Ohtsu
Kazuki Ohtsu
KYKoji Yamamoto
Koji Yamamoto
TNTakayuki Nishio
Takayuki Nishio
MMMasahiro Morikura
Masahiro Morikura

9 September 2022 in IEEE Transactions on Signal and Information Processing over Networks
Verified
Journal Article
Closed access
ATAkihito Taya
Akihito Taya
TNTakayuki Nishio
Takayuki Nishio
MMMasahiro Morikura
Masahiro Morikura
KYKoji Yamamoto
Koji Yamamoto
This paper proposes a fully decentralized federated learning (FL) scheme for Internet of Everything (IoE) devices that are connected via multi-hop networks. Because FL algorithms hardly converge the parameters of machine learning (ML) models, this paper focuses on the convergence of ML models in function spaces . Considering that the representative loss functions of ML tasks e.g., mean squared error (MSE) and Kullback-Leibler (KL) divergence, are convex functionals , algorithms that directly update functions in function spaces could converge to the optimal solution. The key concept of this paper is to tailor a consensus-based optimization algorithm to work in the function space and achieve the global optimum in a distributed manner. This paper first analyzes the convergence of the proposed algorithm in a function space, which is referred to as a meta-algorithm, and shows that the spectral graph theory can be applied to the function space in a manner similar to that of numerical vectors. Then, consensus-based multi-hop federated distillation (CMFD) is developed for a neural network (NN) to implement the meta-algorithm. CMFD leverages knowledge distillation to realize function aggregation among adjacent devices without parameter averaging. An advantage of CMFD is that it works even with different NN models among the distributed learners. Although CMFD does not perfectly reflect the behavior of the meta-algorithm, the discussion of the meta-algorithm's convergence property promotes an intuitive understanding of CMFD, and simulation evaluations show that NN models converge using CMFD for several tasks. The simulation results also show that CMFD achieves higher accuracy than parameter aggregation for weakly connected networks, and CMFD is more stable than parameter aggregation methods