Federated learning (FL) is a privacy-preserving technique for training a vast amount of decentralized data and making inferences on mobile devices. As a typical language modeling problem, mobile keyboard prediction aims at suggesting a probable next word or phrase and facilitating the human-machine interaction in a virtual keyboard of the smartphone or laptop. Mobile keyboard prediction with FL hopes to satisfy the growing demand that high-level data privacy be preserved in artificial intelligence applications even with the distributed models training. However, there are two major problems in the federated optimization for the prediction: (1) aggregating model parameters on the server-side and (2) reducing communication costs caused by model weights collection. To address the above issues, traditional FL methods simply use averaging aggregation or ignore communication costs. We propose a novel Federated Mediation (FedMed) framework with the adaptive aggregation, mediation incentive scheme, and topK strategy to address the model aggregation and communication costs. The performance is evaluated in terms of perplexity and communication rounds. Experiments are conducted on three datasets (i.e., Penn Treebank, WikiText-2, and Yelp) and the results demonstrate that our FedMed framework achieves robust performance and outperforms baseline approaches.
8 December 2022 in IEEE Transactions on Medical Imaging
Current computer-aided diagnosis system with deep learning method plays an important role in the field of medical imaging. The collaborative diagnosis of diseases by multiple medical institutions has become a popular trend. However, large scale annotations put heavy burdens on medical experts. Furthermore, the centralized learning system has defects in privacy protection and model generalization. To meet these challenges, we propose two federated active learning methods for multicenter collaborative diagnosis of diseases: the Labeling Efficient Federated Active Learning (LEFAL) and the Training Efficient Federated Active Learning (TEFAL). The proposed LEFAL applies a task-agnostic hybrid sampling strategy considering data uncertainty and diversity simultaneously to improve data efficiency. The proposed TEFAL evaluates the client informativeness with a discriminator to improve client efficiency. On the Hyper-Kvasir dataset for gastrointestinal disease diagnosis, with only 65% of labeled data, the LEFAL achieves 95% performance on the segmentation task with whole labeled data. Moreover, on the CC-CCII dataset for COVID-19 diagnosis, with only 50 iterations, the accuracy and F1-score of TEFAL are 0.90 and 0.95, respectively on the classification task. Extensive experimental results demonstrate that the proposed federated active learning methods outperform state-of-the-art methods on segmentation and classification tasks for multicenter collaborative disease diagnosis.
Fog computing is a promising solution to enable delay-sensitive applications in the Internet of Things (IoT). In this paper, based on the simultaneous wireless information and power transfer (SWIPT) technology, we investigate the joint offloading of tasks and energy in fog-enabled IoT networks. Specifically, the task node is allowed to offload energy and tasks to multiple neighboring helper nodes in a time division multiple access (TDMA) manner. When there are no task queues in the nodes, the offloading decision for each task is independent. We first find the offloading strategy to minimize the task execution delay as well as the energy consumption for a specific task and then analyze the condition under which the joint offloading of tasks and energy is beneficial. We show that it becomes more and more desirable to offload both the tasks and the energy from the task node as the number of helper nodes gets large. When there are task queues in the nodes, the offloading decision for each task becomes temporally correlated. We then characterize the optimal strategies to offload the tasks and energy jointly over multiple time slots. An online offloading policy based on the Lyapunov optimization is then proposed to minimize the time average expected delay while stabilizing the system operation. Comprehensive numerical results corroborate our theoretical results and demonstrate the superior performance of the proposed JOTE algorithms.
11 October 2022 in IEEE Transactions on Intelligent Transportation Systems
Trajectory data contains rich spatial and temporal information. Turning trajectories into graphs and then analyzing them efficiently in an AI-empowered way is a representative branch of trajectory analysis in IoV and ITS environments, which is of great significance. This research attempts to project trajectories onto road networks to predict traffic conditions. Extracting accurate spatio-temporal dependencies is the key to improving the analysis. However, two problems exist in the current study. The first one is the focus on the network structure while ignoring node features, and the second one is that the structure cannot be fully utilized. In addition, the static spatial structure may not accurately reflect the dynamic real spatial dependency. In response to these problems, a novel Spatio-Temporal Graph Convolutional Networks via View Fusion for Trajectory Data Analytics (STFGCN) model is designed. It contains two independent views: the structural view and feature view. The view fusion layer is further designed. It includes an extended graph convolutional module and a causal dilated module. The extended graph convolutional module fully extracts dynamic spatial dependencies, while the causal dilated module captures time tendencies. Stacked view fusion layers and a view fusion module perform fusion operations based on the advantages of the two views, efficiently integrating information from both. Several experiments are performed on two real-world trajectory datasets. The results show that a better prediction performance is obtained, especially on the long-range time prediction task.
Quality prediction in the continuous casting process is of great significance to the quality improvement of casting slabs. Due to the uncertainty and nonlinear relationship between the quality of continuous casting slabs (CCSs) and various factors, reliable prediction of CCS quality poses a challenge to the steel industry. However, traditional prediction models based on domain knowledge and expertise are difficult to adapt to the changes in multiple operating conditions and raw materials from various enterprises. To meet the challenge, we propose a framework with a multiscale convolutional and recurrent neural network (MCRNN) for reliable CCS quality prediction. The proposed framework outperforms conventional time series classification methods with better feature representation since the input is transformed at different scales and frequencies, which captures both long-term trends and short-term changes in time series. Moreover, we generate different category distributions based on the random undersampling (RUS) method to mitigate the impact of the skewed data distribution due to the natural imbalance of continuous casting data. The experimental results and comprehensive comparison with the state-of-the-art methods show the superiority of the proposed MCRNN framework, which has not only satisfactory prediction performance but also good potential to improve continuous casting process understanding and CCS quality.