Xingyu Feng

Dr. Xingyu Feng


Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 January 2023 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
Xingyu FengXingyu Feng
Xingyu Feng
Chengwen LuoChengwen Luo
Chengwen Luo
JCJiongzhang Chen
Jiongzhang Chen
YHYijing Huang
Yijing Huang
JZJin Zhang
Jin Zhang
Victor C. M. LeungVictor C. M. Leung
Victor C. M. Leung
Recently proposed split learning (SL) is a promising distributed machine learning paradigm that enables machine learning without accessing the raw data of the clients. SL can be viewed as one specific type of serial federation learning. However, deploying SL on resource-constrained Internet of Things (IoT) devices still has some limitations, including high communication costs and catastrophic forgetting problems caused by imbalanced data distribution of devices. In this article, we design and implement IoTSL, which is an efficient distributed learning framework for efficient cloud-edge collaboration in IoT systems. IoTSL combines generative adversarial networks (GANs) and differential privacy techniques to train local data-based generators on participating devices, and generate data with privacy protection. On the one hand, IoTSL pretrains the global model using the generative data, and then fine-tunes the model using the local data to lower the communication cost. On the other hand, the generated data is used to impute the missing classes of devices to alleviate the commonly seen catastrophic forgetting phenomenon. We use three common data sets to verify the proposed framework. Extensive experimental results show that compared to the conventional SL, IoTSL significantly reduces communication costs, and efficiently alleviates the catastrophic forgetting phenomenon.

6 May 2022 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
Xingyu FengXingyu Feng
Xingyu Feng
Chengwen LuoChengwen Luo
Chengwen Luo
Bo WeiBo Wei
Bo Wei
JZJin Zhang
Jin Zhang
JLJianqiang Li
Jianqiang Li
Victor C. M. LeungVictor C. M. Leung
Victor C. M. Leung
Recently we have witnessed the rise of Artificial Intelligence of Things (AIoT) and the shift of sensing paradigm from cloud-centric to the edge-centric, which effectively improves the sensing capability of intelligence transportation systems. To improve the real-time sensing performance, in this work we propose an ensemble sensing based scheme to solve the time-constraint synchronized inference problem and achieve robust inference with heterogeneous IoT devices in intelligence transportation systems. We design and implement Ensen, which incorporates various novel techniques such as customized DNN model design, KD-based model training, and dynamic deep ensemble management, etc., to achieve improved accuracy and maximize the computational resource usage of the whole sensing group. Extensive evaluations on different types of common IoT devices have shown that Ensen achieves a robust performance and can be easily extended to different types of convolutional neural networks.

23 December 2024 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
Xingyu FengXingyu Feng
Xingyu Feng
RJRenqi Jia
Renqi Jia
Chengwen LuoChengwen Luo
Chengwen Luo
Victor C. M. LeungVictor C. M. Leung
Victor C. M. Leung
WXWeitao Xu
Weitao Xu
Split learning (SL) is widely regarded as a promising distributed machine learning framework with superior privacy-preserving properties, lower communication and computation costs. However, in real Internet of Things (IoT) scenarios, existing SL may not perform well because the local data of IoT devices often do not follow the same distribution. This leads to the model continuously adapting to the current data distribution in each training epoch, resulting in a catastrophic forgetting phenomenon. Existing methods typically attempt to add raw or generated data from previous devices in the current training epoch to review knowledge, but direct access to the local data of other devices carries serious privacy risks. Data augmentation techniques based on generative networks often have poor robustness and increase the computation cost on the device side. To address these challenges, we propose a new SL framework called SL without Forgetting (SLwF). To mitigate catastrophic forgetting without accessing any previous data, we propose a contrastive learning-based training method that leverages current training data to review previous knowledge, and learn new knowledge better. Furthermore, we adopt an exponential moving average (EMA)-based model update strategy to preserve lost knowledge, further alleviating the forgetting problem. We implement the SLwF framework in real IoT scenarios and extensively evaluated its performance using four publicly available datasets. Compared to other related research (e.g., IoTSL), SLwF performs better in terms of final accuracy and robustness while avoiding excessive device energy consumption.

1 December 2023 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
Chengwen LuoChengwen Luo
Chengwen Luo
JCJiongzhang Chen
Jiongzhang Chen
Xingyu FengXingyu Feng
Xingyu Feng
JZJin Zhang
Jin Zhang
JLJianqiang Li
Jianqiang Li

27 June 2023 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
Xingyu FengXingyu Feng
Xingyu Feng
LLLingjie Li
Lingjie Li
TWTenglong Wang
Tenglong Wang
WXWeitao Xu
Weitao Xu
JZJin Zhang
Jin Zhang
Chengwen LuoChengwen Luo
Chengwen Luo
The capability of local smart sensing based on IoT devices is typically limited due to due to the inherent limitations of computational and storage capabilities. Recently, collaborative inference among multiple devices has been considered as an effective way to improve the sensing capabilities of individual IoT devices. However, the collaborative inference process still faces the challenges of data privacy leakage and inefficient collaboration. To alleviate the above issues, we design a blockchainbased collaborative inference system in this paper, called CoBC, which allows each heterogeneous device node on the blockchain to customize a personalized local machine learning model according to its own hardware constraint and performance, thus improving the efficiency of resource utilization of the whole system. Meanwhile, each device node only needs to complete training locally, which significantly reduces the risk of privacy leakage due to the remote transmission of local data. CoBC improves the sensing capability of single device nodes by using collaborative inference that can obtain a more robust global inference. In addition, CoBC employs a Bayesian approximation training approach to evaluate the output uncertainty of each device node to further improve the efficiency of collaborative inference. To evaluate the performance, we deploy CoBC in a real environment and conduct a large number of simulations to evaluate the efficiency of CoBC. The simulation results demonstrate that CoBC exhibits good performance and good practicality in various criteria.

5 September 2024 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
Xingyu FengXingyu Feng
Xingyu Feng
Chengwen LuoChengwen Luo
Chengwen Luo
JCJunliang Chen
Junliang Chen
JLJianqiang Li
Jianqiang Li
LZLi Zhang
Li Zhang
WXWeitao Xu
Weitao Xu
Proper and effective toothbrushing technique is crucial for maintaining oral health. However, there are often limited opportunities for individuals to receive specific training in toothbrushing posture in their daily lives. In this article, we propose Hygiea+, a convenient, energy-efficient, and highly accurate toothbrushing monitoring system based on wrist-worn wearables. By leveraging inertial measurement units (IMUs) in wrist-worn devices for gesture sensing, Hygiea+ enables users to accurately and efficiently monitor their toothbrushing activities without any modifications to the toothbrush. We propose a number of novel techniques to achieve the goal of high sensing accuracy and energy efficiency. To reduce the energy consumption of continuous IMU sampling, we model the sensing problem as a Markov process and design a partially observable Markov decision process (POMDP)-based adaptive sampling strategy to dynamically adjust the sampling frequency. To achieve high sensing accuracy, we first propose a novel signal preprocessing method to mitigate variations resulting from different toothbrush types and user habits. Then, we propose a deep reinforcement learning-based data distillation mechanism to extract key segments from continuous toothbrushing actions, thus reducing the impact of redundant data and noise. In the classification stage, we design an attention-based long short-term memory (AT-LSTM) network for fine-grained toothbrushing posture recognition. In addition, to address the accuracy degradation of new users, we adopt the common but effective fine-tuning method to alleviate the data collection burden on new users. Finally, we connect advanced large language models (LLMs) to provide users with necessary feedback on toothbrushing behavior and health recommendations. Extensive experiments using both manual and electric toothbrushes demonstrate Hygiea+ achieves up to 98.8% accuracy in toothbrushing posture recognition while maintaining superior energy efficiency.