With the proliferation of machine learning, the cloud server has been employed to collect massive data and train machine learning models. Several privacy-preserving machine learning schemes have been suggested recently to guarantee data and model privacy in the cloud. However, these schemes either mandate the involvement of the data owner in model training or utilize high-cost cryptographic techniques, resulting in excessive computational and communication overheads. Furthermore, none of the existing work considers the malicious behavior of the cloud server during model training. In this paper, we propose the first privacy-preserving and verifiable support vector machine training scheme by employing a two-cloud platform. Specifically, based on the homomorphic verification tag, we design a verification mechanism to enable verifiable machine learning training. Meanwhile, to improve the efficiency of model training, we combine homomorphic encryption and data perturbation to design an efficient multiplication operation for the encryption domain. A rigorous theoretical analysis demonstrates the security and reliability of our scheme. The experimental results indicate that our scheme can reduce computational and communication overheads by at least 43.94% and 99.58%, respectively, compared to state-of-the-art SVM training methods.
22 September 2022 in IEEE Transactions on Dependable and Secure Computing
The neural network has been widely used to train predictive models for applications such as image processing, disease prediction, and face recognition. To produce more accurate models, powerful third parties (e.g., clouds) are usually employed to collect data from a large number of users, which however may raise concerns about user privacy. In this paper, we propose an Efficient and Privacy-preserving Neural Network scheme, named EPNN, to deal with the privacy issues in cloud-based neural networks. EPNN is designed based on a two-cloud model and techniques of data perturbation and additively homomorphic cryptosystem. This scheme enables two clouds to cooperatively perform neural network training and prediction in a privacy-preserving manner and significantly reduces the computation and communication overhead among participating entities. Through a detailed analysis, we demonstrate the security of EPNN. Extensive experiments based on real-world datasets show EPNN is more efficient than existing schemes in terms of computational costs and communication overhead.
Applying artificial intelligence (AI) to mobile networks can significantly enhance inference services, driving the rapid evolution towards smarter, more efficient networks. As next-generation mobile networks are deployed, they are expected to provide higher data rates and lower latency, which presents challenges for traditional large-model inference. These challenges necessitate that inference architectures and models quickly adapt to meet growing demands and handle increasingly complex tasks. To tackle these issues, the cloud-edge-end collaborative inference framework has emerged as a highly effective solution. This framework facilitates intelligent collaboration across the cloud, edge, and end devices, optimizing computational resources at all levels. Building on this approach, this article proposes a collaborative inference system specifically designed for mobile networks, addressing critical issues like computational bottlenecks and inference latency in traditional model deployments. The system integrates an innovative task offloading strategy and advanced model acceleration techniques, resulting in reduced inference latency. Experimental results show that the system not only significantly lowers latency but also maintains high-quality output. Finally, the article discusses future development trends in cloud-edge-end collaborative inference systems.
29 January 2024 in IEEE Internet of Things Journal
Privacy-preserving truth discovery, as a data aggregation algorithm that can extract reliable results from disparate and conflicting data in a privacy-preserving manner, has received a lot of attention in ensuring the reliability and privacy of data in mobile crowdsensing systems. However, most of the existing work requires that workers must stay online all the time during the full process of truth discovery. Although a few recent schemes have been proposed to tolerate worker dropout, they are tailored for a single-round setting. Repeating these schemes several times to adapt to the truth discovery will introduce significant computational and communication overheads, especially for the workers. To solve the above challenges, in this paper, we propose a multi-round efficient and secure truth discovery scheme in mobile crowdsensing systems that can balance the 3-way trade-off between privacy protection, dropout tolerance, and protocol efficiency. Specifically, we devise a novel mask generation capable of reusing secrets to eliminate the costly overhead of workers needing to recompute new secrets each round. Besides, we design a lightweight dropout tolerance mechanism to guarantee that even if workers drop out halfway, the server can still acquire meaningful truth. Rigorous security analysis and extensive experimental results demonstrate the privacy and efficiency of our scheme, respectively.
9 January 2025 in IEEE Transactions on Cognitive Communications and Networking
With the rapid advancement of artificial intelligence, generative artificial intelligence (GAI) has taken a leading role in transforming data processing methods. However, the high computational demands of GAI present challenges for devices with limited resources. As we move towards the sixth generation of mobile networks (6G), the higher data rates of 6G create a need for more efficient data processing in GAI. Traditional GAI, however, shows its limitations in meeting these demands. To address these challenges, we introduce a multi-level collaborative inference system designed for next-generation networks and communication. Our proposed system features a deployment strategy that assigns models of varying sizes to devices at different network layers. Then, we design a task offloading strategy to optimise both efficiency and latency. Furthermore, a modified early exit mechanism is implemented to enhance the inference process for single models. Experimental results demonstrate that our system effectively reduces inference latency while maintaining high-quality output. Specifically, compared to existing work, our system can reduce inference time by up to 17% without sacrificing the inference accuracy.
Machine learning has become increasingly popular in academic and industrial communities and has been widely implemented in various online applications due to its powerful ability to analyze and use data. Among all the machine learning models, decision tree models stand out due to their great interpretability and simplicity, and have been implemented in cloud computing services for various purposes. Despite its great success, the integrity issue of online decision tree prediction is a growing concern. The correctness and consistency of decision tree predictions in cloud computing systems need more security guarantees since verifying the correctness of the model prediction remains challenging. Meanwhile, blockchain has a promising prospect in two-party machine learning services as the immutable and traceable characteristics satisfy the verifiable settings in machine learning services. In this paper, we initiate the study of decision tree prediction services on blockchain systems and propose VDT, a Verifiable Decision Tree prediction scheme for decision tree prediction. Specifically, by leveraging the Merkle tree and hash function, the scheme allows the service provider to generate a verification proof to convince the client that the output of the decision tree prediction is correctly computed on a particular data sample. It is further extended to an update method for a verifiable decision tree to modify the decision tree model efficiently. We prove the security of the proposed VDT schemes and evaluate their performance using real datasets. Experimental evaluations show that our scheme requires less than one second to produce verifiable proof.