Industrial Internet of Things (IIoT), which has the capability of perception, monitoring, communication and decision–making, has already exposed more security problems that are easy to be invaded by malware because of many simple edge devices that help smart factories, smart cities and smart homes. In this paper, a two–layer malware spread–patch model IIPV is proposed based on a hybrid patches distribution method according to the simple edge equipments and limited central computer resources of IIoT. The spread process of malware in IIoT was deeply analyzed using differential game and a differential game model was established. Then optimization theory was further used to solve the optimization problem extracted by introducing subjective effort parameters to obtain the optimal control strategies of devices for malware and patches. In addition, we combined the deep reinforcement learning algorithm into the model IIPV to design a new algorithm DDQN – PV suitable for suppressing the spread of malware in IIoT during the experiments. Finally, the effectiveness of model IIPV and algorithm DDQN – PV are verified by numerous comparative experiments.

In the scenario of Industry 4.0, mobile smart devices (SDs) on production lines have to process massive amounts of data. These computing tasks sometimes far exceed the computing capability of SDs and require lots of energy and time to process. How to effectively reduce energy consumption and latency is necessary to be solved. To this end, we first propose an SDN (Software Defined Network)-based MEC (Mobile Edge Computing) system. In the MEC system, SDs can offload computation tasks to edge servers to decrease the processing latency and avoid the waste of energy. At the same time, taking advantage of SDNs programmability, scalability, and isolation of the control plane and the data plane, an SDN controller can manage edge devices within the MEC system. Secondly, based on a stochastic game, we study the computation offloading and resource allocation problems in the MEC system and establish a stochastic game-based computation offloading model. Furthermore, we prove that the multi-user stochastic game in this system can achieve Nash Equilibrium. We further consider each SD as an independent agent and design a stochastic game-based resource allocation algorithm with prioritized experience replays (SGRA-PER) to minimize energy consumption and processing latency with Multi-Agent Reinforcement Learning. Experiment results demonstrate that the proposed SGRA-PER is superior to MADDPG, Q-Mix, and MAPPO algorithms, which can significantly reduce the processing delay and energy consumption with dynamic resource allocation. Moreover, SGRA-PER can still keep a higher performance under the increase of SDs, which can be applied in a large-scale MEC system.

Industrial Internet of Things (IIoT) has brought a lot of convenience for the industrial world to digitization, automation and intelligence, but it inevitably introduces inherent cyber security risks, resulting in an issue that traditional intrusion detection techniques are no longer sufficient for IIoT environments. To solve this issue, we propose an open-set solution called DC-IDS for IIoT based on deep reinforcement learning. In this solution, the open-set recognition problem in intrusion detection is modeled as a discrete-time Markov decision process, and Deep Q-Network (DQN) is employed to solve it. Meanwhile, a Conditional Variational Auto-Encoder is introduced to the value network in DQN. Therefore, the open-set recognition problem in intrusion detection is divided into two subproblems, namely known traffic fine-grained classification problem and unknown attacks recognition problem. We use DQN to solve the known traffic fine-grained classification problem. Since the reconstruction error of known traffic is generally smaller than the reconstruction error of unknown attacks, we use reconstruction error to recognize unknown attacks. Experiments on IIoT dataset TON-IoT demonstrate the effectiveness of DC-IDS model, which achieves better performance in terms of the recognition rate of unknown attacks as well as the stability of the model compared to previous proposed methods.