Cybersecurity ventures expect that cyber-attack damage costs will rise to $11.5 billion in 2019 and that a business will fall victim to a cyber-attack every 14 seconds. Notice here that the time frame for such an event is seconds. With petabytes of data generated each day, this is a challenging task for traditional intrusion detection systems (IDSs). Protecting sensitive information is a major concern for both businesses and governments. Therefore, the need for a real-time, large-scale and effective IDS is a must. In this work, we present a cloud-based, fault tolerant, scalable and distributed IDS that uses Apache Spark Structured Streaming and its Machine Learning library (MLlib) to detect intrusions in real-time. To demonstrate the efficacy and effectivity of this system, we implement the proposed system within Microsoft Azure Cloud, as it provides both processing power and storage capabilities. A decision tree algorithm is used to predict the nature of incoming data. For this task, the use of the MAWILab dataset as a data source will give better insights about the system capabilities against cyber-attacks. The experimental results showed a 99.95% accuracy and more than 55,175 events per second were processed by the proposed system on a small cluster.
2 November 2023 in Multimedia Tools and Applications
The rapid proliferation of Internet of Things (IoT) devices has transformed our daily lives, introducing innovations like smart homes, wearables, and advanced industrial automation. While these interconnected systems offer convenience and efficiency, they also present significant security challenges. The increasing complexity and scale of IoT networks elevate the risk of malicious attacks, making the protection of these networks a pressing concern. Despite advancements in intrusion detection systems (IDS), existing methods often struggle to balance accuracy and computational efficiency, leading to higher false positive rates and inadequate detection of sophisticated threats. Traditional machine learning approaches frequently fall short in adapting to the evolving nature of attacks, thereby highlighting the necessity for more robust solutions. In response to these challenges, our study proposes an ensemble learning approach that utilizes bagging to enhance intrusion detection systems in IoT environments. By integrating the strengths of Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs), we aim to leverage their unique advantages to improve the detection accuracy and resilience of IDS against a diverse range of cyber threats. To evaluate the effectiveness of our proposed model, we utilized the Edge-IIoTset dataset, which contains a comprehensive range of network traffic scenarios, including both normal and malicious behaviors. This dataset enables us to rigorously train and assess our models, ensuring their applicability in real-world IoT security contexts.