With successful machine learning applications in many fields, researchers tried to introduce machine learning into intrusion detection systems for building classification models. Although experimental results showed that these classification models could produce higher accuracy in predicting network attacks on the offline datasets, compared with the operational intrusion detection systems, machine learning is rarely deployed in the real intrusion detection environment. This is what we call the last mile problem with the machine learning approach to network intrusion detection, the discrepancy between the strength and requirements of machine learning and network operational semantics. In this paper, we aim to bridge the aforementioned gap. In particular, an LCC-RF-RFEX feature selection approach is proposed to select optimal features of the specific type of attacks from dataset, and then, an intrusion-specific approach is introduced to convert them into detection patterns that can be used by the nonmachine-learning detector for the corresponding specific attack detection in the real-world network environment. To substantiate our approach, we take Snort, KDDCup’99 dataset, and Dos attacks as the experimental subjects to demonstrate how to close the last-mile gap. For the specific type of Dos attacks in the KDDCup’99 dataset, we use the LCC-RF-RFEX method to select optimal feature subset and utilize our intrusion-specific approach to generate new rules in Snort by using them. Comparing performance differences between the existing Snort rule set and our augmented Snort rule set with regard to Dos attacks, the experimental results showed that our approach expanded Snort’s detection capability of Dos attacks, on average, reduced up to 25.28% false-positive alerts for Teardrop attacks and Synflood attacks, and decreased up to 98.87% excessive alerts for Mail bomb attacks.
As we know, the redundant and irrelevant features in the network dataset not only add consumption time of the constructing classification models but also decline their accuracy. Therefore, many feature selection approaches are adopted to filter the irrelevant and redundant features from the massive network dataset, which finally improves the performance of the built classification models. At the same time, compared with other measures of association, such as Pearson, distance correlation, and mutual information, the maximal information coefficient can capture more wide range of linear or non-linear associations between two random variables. Therefore, this paper proposed a novel filter method for intrusion detection, the Maximal Information Coefficient-based feature selection method, which can extract the optimized features from the initial network dataset by removing the redundant and irrelevant features. The experiments are conducted using our proposed approach for intrusion detection on the KDDCup’99 dataset. The experimental results showed our proposed method can help the intrusion detection system obtain a higher accuracy rate and the lower false positive rate than other feature selection methods.
This paper introduces a weak optical signal processing scheme based on FPGA. Through the design of weak signal conditioning module, data acquisition control module, FPGA and peripheral modules, multi-channel acquisition, amplification, filtering and processing of weak light signals are realized. Finally, the feasibility of the scheme is verified through relevant experiments.