With the integration of Artificial Intelligence (AI) and Internet of Things (IoT), the Federated Edge Learning (FEL), a promising computing framework is developing. However, there are still unsolved issues on communication efficiency and data security due to the huge models and unreliable transmission links. To address these issues, this paper proposes a novel federated edge learning system, called LightFed, where the edge nodes upload only vital partial local models, and successfully achieve lightweight communication and model aggregation. First, a novel model aggregation method Model Splitting and Splicing (MSS) and a Selective Parameter Transmission (SPT) scheme are proposed. By detecting the updating gradients of local parameters and filtering significant parameters, selective rotated transmission and efficient aggregation of local models are achieved. Second, a Training Filling Model (TFM) is proposed to infer the total data distribution of edge nodes, and train a filling model to mitigate the unbalanced training data without violating the data privacy of individual users. Moreover, a blockchain-powered confusion transmission mechanism is proposed for defending the attacks from external adversaries and protecting the model information. Finally, extensive experimental results demonstrate that our LightFed significantly outperforms the existing FEL systems in terms of communication efficiency and privacy security.
25 November 2024 in IEEE Transactions on Services Computing
Mobile Crowd Sensing is a prevalent and efficient paradigm for multi-source data collection, where Multi-source Data Fusion (MDF) plays a crucial role in constructing quality data collection services. Current MDF methods often require the majority of participating sensing sources to be credible, or assume that the workers' credibility is either prior known or easily calculable. However, due to the presence of uncredible environments and the problem of Information Elicitation Without Verification (IEWV), these methods are impractical. It may lead to a vicious cycle where the recruitment of uncredible workers affects the quality of the estimated truth, which can further lead to misjudgments of worker credibility, thereby exacerbating the quality of subsequent recruitment. In this paper, a Reliable Multi-source Data Fusion scheme with Cross Validation (RMDFCV) is proposed to obtain reliable truth for service construction. Specifically, we first introduce the Combinatorial Multi-Armed Bandit (CMAB) model to recruit high-credibility workers by balancing exploration and exploitation. Then, we establish threestage truth data through three different data sources: Unmanned Aerial Vehicles, credible workers, and Deep Matrix Factorization. Theoretical analyses and extensive simulations confirm the excellent performance of our RMDF-CV scheme.
29 April 2025 in IEEE Transactions on Services Computing
In the service of Mobile Crowd Sensing (MCS), High-quality Data Collection (HDC), Bilateral Location Privacy Preservation (BLPP), and sensing cost are three pivotal issues. It is widely believed that HDC necessitates the recruitment of workers with high Quality of Service (QoS), which is related to the sensing data capabilities of the recruited workers and the worker-task distances. However, submitting high-quality data demands more resources from the workers, incurring higher costs. Meanwhile, BLPP techniques, aiming to conceal the locations of the workers and tasks, may impede the evaluation of the workers' QoS. Therefore, there is still a lack of a low-cost and BLPP high QoS data collection research. Motivated by this, we propose a Quality-Aware, Low-Cost, and Privacy-Preserving Data Collection Service (QLP-DCS) for MCS. First, we propose a matrix perturbation-based approach to achieve BLPP while preserving the partial order relationship of distances. Subsequently, we employ the Upper Confidence Bound indexes-based reverse auction recruiting workers to balance exploration and exploitation with the low sensing cost. Then, we propose a multi-level truth discovery approach and establish an effective trust verification mechanism. Theoretical analysis and extensive experiments validate the superior performance of our QLP-DCS.
7 March 2025 in IEEE Transactions on Mobile Computing
As a promising paradigm, federated learning has been applied to multimodal sensing tasks due to its deployment convenience. However, the recent advances in multimodal federated learning emphasize learning a high-quality multimodal model but overlook the model usage requirements of massive unimodal clients. Moreover, the privacy risk in model sharing and client data heterogeneity impact the efficacy of federated learning. In this paper, we propose a novel multimodal federated learning system named MASA. As a departure from existing approaches, MASA simultaneously enhances the model learning efficiency of both multimodal and unimodal clients while ensuring their data privacy. First, we employ a gated cross-modal distillation scheme to achieve performance-aware knowledge transfer across modality-heterogeneous clients. To enhance the system security, MASA integrates a lightweight split-shuffle mechanism to realize the anonymization and encryption of model aggregation. Moreover, to reach personalized collaboration while protecting privacy, MASA features an attention-based spontaneous client clustering mechanism to form client cluster structures securely and distributedly. We evaluate our MASA on four public multimodal datasets for human activity recognition. The results show that our MASA outperforms leading multimodal federated learning methods on the model performance of both multimodal and unimodal clients.
30 August 2024 in IEEE Transactions on Mobile Computing
As a promising approach, Clustered Federated Learning (CFL) enables personalized model aggregation for heterogeneous clients. However, facing dynamic and open edge networks, previous CFL rarely considers the impact of dynamic client data on clustering validity, or sensitively identifies low-quality parameters from highly heterogeneous client models. Moreover, the device heterogeneity in each cluster leads to unbalanced model transmission delay, thus reducing the system efficiency. To tackle the above issues, this paper proposes a Robust and Efficient Clustered Federated System (REC-Fed). First, a Hierarchical Attention based Robust Aggregation (HARA) method is designed to realize layer-wise model customization for clients, meanwhile keeping the clustering validity under dynamic client data distribution. In addition, the fine-grained parameter detection in HARA provides a natural advantage to detect low-quality parameters, which improves the robustness of CFL systems. Second, to realize efficient synchronous model transmission, an Adaptive Model Transmission Optimization (AMTO) is proposed to jointly optimize the model compression and bandwidth allocation for heterogenous clients. Finally, we theoretically analyze the convergence of REC-Fed and conduct experiments on several personalization tasks, which demonstrate that our REC-Fed has significant improvement on flexibility, robustness and efficiency.