Evaluation of Machine Learning Algorithms in Network-Based Intrusion Detection System

本文主要是介绍Evaluation of Machine Learning Algorithms in Network-Based Intrusion Detection System，对大家解决编程问题具有一定的参考价值，需要的程序猿们随着小编来一起学习吧！

本文提出了一种更好的对测试集进行有效评估的方法，从而防止训练造成过拟合现象。经过实验表明，SVM和ANN对过拟合的免疫能力是最强的。链接为：https://arxiv.org/abs/2203.05232。

Cybersecurity has become one of the focuses of organisations. The number of cyberattacks keeps increasing as Internet usage continues to grow.

An intrusion detection system (IDS) is an alarm system that helps to detect cyberattacks.

As new types of cyberattacks continue to emerge, researchers focus on developing machine learning (ML)-based IDS to detect zero-day attacks.

Researchers usually remove some or all attack samples from the training dataset and only include them in the testing dataset when evaluating the performance of an IDS on detecting zero-day attacks.

Although this method may show the ability of an IDs to detect unknown attacks; however, it does not reflect the long-term performance of the IDS as it only shows the changes in the type of attacks.

In this paper, we focus on evaluating the long-term performance of ML-based IDS. To achieve this goal, we propose evaluating the ML-based IDS using a dataset that is created later than the training dataset.

The proposed method can better assess the longterm performance of an ML-based IDS, as the testing dataset reflects the changes in the type of attack and the changes in network infrastructure over time.

We have implemented six of the most popular ML models
that are used for IDS, including decision tree (DT), random forest (RF), support vector machine (SVM),
naïve Bayes (NB), artificial neural network (ANN) and deep neural network (DNN).

Our experiments using the CIC-IDS2017 and the CSE-CIC-IDS2018 datasets show that SVM and ANN are most resistant
to overfitting.

Besides that, our experiment results also show that DT and RF suffer the most from overfitting, although they perform well on the training dataset. On the other hand, our experiments using
the LUFlow dataset have shown that all models can perform well when the difference between the training and testing datasets is small.

这篇关于Evaluation of Machine Learning Algorithms in Network-Based Intrusion Detection System的文章就介绍到这儿，希望我们推荐的文章对大家有所帮助，也希望大家多多支持为之网！