Deep learning can achieve higher accuracy than traditional machine learning algorithms in a variety of machine learning tasks. Recently, privacy-preserving deep learning has drawn tremendous attention from information security community, in which neither training data nor the training model is expected to be exposed. Federated learning is a popular learning mechanism, where multiple parties upload local gradients to a server and the server updates model parameters with the collected gradients. However, there are many security problems neglected in federated learning, for example, the participants may behave incorrectly in gradient collecting or parameter updating, and the server may be malicious as well. In this paper, we present a distributed, secure, and fair deep learning framework named \textit{DeepChain} to solve these problems. DeepChain provides a value-driven incentive mechanism based on Blockchain to force the participants to behave correctly. Meanwhile, DeepChain guarantees data privacy for each participant and provides auditability for the whole training process. We implement a DeepChain prototype and conduct experiments on a real dataset for different settings, and the results show that our DeepChain is promising.
19 November 2018 in IEEE Transactions on Parallel and Distributed Systems
Crowdsourcing systems which utilize the human intelligence to solve complex tasks have gained considerable interest and adoption in recent years. However, the majority of existing crowdsourcing systems rely on central servers, which are subject to the weaknesses of traditional trust-based model, such as single point of failure. They are also vulnerable to distributed denial of service (DDoS) and Sybil attacks due to malicious users involvement. In addition, high service fees from the crowdsourcing platform may hinder the development of crowdsourcing. How to address these potential issues has both research and substantial value. In this paper, we conceptualize a blockchain-based decentralized framework for crowdsourcing named CrowdBC, in which a requester's task can be solved by a crowd of workers without relying on any third trusted institution, users' privacy can be guaranteed and only low transaction fees are required. In particular, we introduce the architecture of our proposed framework, based on which we give a concrete scheme. We further implement a software prototype on Ethereum public test network with real-world dataset. Experiment results show the feasibility, usability and scalability of our proposed crowdsourcing system.
As a typical kind of the Internet of Things, smart grid has attracted a lot of attentions. The power energy management of smart grid is of great importance for energy distribution, system security and market economics. One of the most important issues is the accurate and stable prediction of wind speed for the optimal operation and management of wind power generations connected to smart grid. In this study, a novel two-layer nonlinear combination method termed as EEL-ELM is developed for short-term wind speed prediction problems such as ten-minute ahead and one-hour ahead. The first layer is based on extreme learning machine (ELM), Elman neural network (ENN) and long short term memory neural network (LSTM) to separately forecast wind speed by making use of their merits of calculation speed or strong ability in forecasting, and obtain three forecasting results. Then, we propose the second layer by making use of ELM-based nonlinear aggregated mechanism to alleviate the inherent weakness of single method and linear combination. Two real-world case studies, gathered from Inner Mongolia’s wind farm in China, are implemented to demonstrate the effectiveness of the proposed EEL-ELM method. By comparing with other eight wind speed prediction methods, the simulation results reveal that EEL-ELM can achieve better forecasting performance according to three evaluation metrics and three statistical tests.
24 August 2021 in IEEE Transactions on Vehicular Technology
With the increasing connectivity between the Electronic Control Units (ECUs) and the outside world, safety and security have become stringent problems. The Controller Area Network (CAN) bus is the most commonly used in-vehicle network protocol, which lacks security mechanisms by design, so it is vulnerable to various attacks. In this paper, we propose a novel intrusion detection model called CNN-LSTM with Attention model (CLAM) for the in-vehicle network, especially CAN. The CLAM model uses one-dimensional convolution (Conv1D) to extract the abstract features of the signal values at each time step and feeds it into the Bidirectional Long Short Term Memory (Bi-LSTM) to extract the time dependence. By combining the attention mechanisms, we calculate the weight of each hidden state output by Bi-LSTM and perform a weighted summation, so that the model focuses only on locally important time steps, which can improve the convergence speed of the model and prediction accuracy. The proposed model uses the bit flip rate to extract continuous signal boundaries in the 64-bit CAN data, so it does not need to parse the CAN communication matrix and is suitable for different vehicles. The extensive evaluation results demonstrate that our proposed CLAM model can effectively detect CAN attacks, with an average F1-score of 0.951 and an error rate of 2.16%. Compared with the work in related research fields, the accuracy of attack detection is improved by 2.5%.
1 February 2019 in Swarm and Evolutionary Computation
Solving Sylvester equation is a common algebraic problem in mathematics and control theory. Different from the traditional fixed-parameter recurrent neural networks, such as gradient-based recurrent neural networks or Zhang neural networks, a novel varying-parameter recurrent neural network, [called varying-parameter convergent-differential neural network (VP-CDNN)] is proposed in this paper for obtaining the online solution to the time-varying Sylvester equation. With time passing by, this kind of new varying-parameter neural network can achieve super-exponential performance. Computer simulation comparisons between the fixed-parameter neural networks and the proposed VP-CDNN via using different kinds of activation functions demonstrate that the proposed VP-CDNN has better convergence and robustness properties.