As one of the promising paradigms of decentralized machine learning, multi-party learning has attracted increasing attention, owing to its capability of preventing the privacy of participants from being directly exposed to adversaries. Multi-party learning enables participants to train their model locally without uploading private data to a server. However, recent studies have shown that adversaries may launch a series of attacks on learning models and extract private information about participants by analyzing the shared parameters. Moreover, existing privacy-preserving multi-party learning approaches consume higher total privacy budgets, which poses a considerable challenge to the compromise between privacy guarantees and model utility. To address this issue, this paper explores an adaptive differentially private multi-party learning framework, which incorporates zero-concentrated differential privacy technique into multi-party learning to get rid of privacy threats, and offers sharper quantitative results. We further design a dynamic privacy budget allocating strategy to alleviate the high accumulation of total privacy budgets and provide better privacy guarantees, without compromising the model’s utility. We inject more noise into model parameters in the early stages of model training and gradually reduce the volume of noise as the direction of gradient descent becomes more accurate. Theoretical analysis and extensive experiments on benchmark datasets validated that our approach could effectively improve the model’s performance with less privacy loss.
Federated learning is a distributed machine learning framework that allows multiple clients to collaborate on training global models without sharing raw data, thereby protecting data privacy. However, it is still a challenge to construct an efficient federated learning method for the semantic segmentation task of automated driving street view. On the one hand, the complexity of the semantic segmentation model is high, resulting in huge computing and communication overhead of client local training. On the other hand, the client data distribution is significantly different and has Non-Independent and Identically Distributed (non-IID) characteristics, which easily leads to the difficulty of global model convergence or the deterioration of generalization performance. Therefore, this paper proposes a Federal Street View segmentation method, Federal Street View Segmentation (FedSS), which optimizes model training by improving the cross-entropy loss function and designing a gradient compensation strategy and a gradient sparse compression strategy to alleviate the high communication overhead in federation learning. Extensive experiments show that our approach can consume fewer computational resources and achieve higher communication efficiency while improving semantic segmentation performance.