Browse > Article
http://dx.doi.org/10.3745/JIPS.03.0174

A Hybrid PSO-BPSO Based Kernel Extreme Learning Machine Model for Intrusion Detection  

Shen, Yanping (School of Information Engineering, Institute of Disaster Prevention)
Zheng, Kangfeng (School of Cyberspace Security, Beijing University of Posts and Telecommunications)
Wu, Chunhua (School of Cyberspace Security, Beijing University of Posts and Telecommunications)
Publication Information
Journal of Information Processing Systems / v.18, no.1, 2022 , pp. 146-158 More about this Journal
Abstract
With the success of the digital economy and the rapid development of its technology, network security has received increasing attention. Intrusion detection technology has always been a focus and hotspot of research. A hybrid model that combines particle swarm optimization (PSO) and kernel extreme learning machine (KELM) is presented in this work. Continuous-valued PSO and binary PSO (BPSO) are adopted together to determine the parameter combination and the feature subset. A fitness function based on the detection rate and the number of selected features is proposed. The results show that the method can simultaneously determine the parameter values and select features. Furthermore, competitive or better accuracy can be obtained using approximately one quarter of the raw input features. Experiments proved that our method is slightly better than the genetic algorithm-based KELM model.
Keywords
Feature Selection; Intrusion Detection; Kernel Extreme Learning Machine; Parameter Optimization; Particle Swarm Optimization;
Citations & Related Records
연도 인용수 순위
  • Reference
1 H. G. Kayacik, A. N. Zincir-Heywood, and M. I. Heywood, "Selecting features for intrusion detection: a feature relevance analysis on KDD 99 intrusion detection datasets," in Proceedings of the 3rd Annual Conference on Privacy, Security and Trust, St. Andrews, Canada, 2005, pp. 1723-1722.
2 S. Elhag, A. Fernandez, A. Bawakid, S. Alshomrani, and F. Herrera, "On the combination of genetic fuzzy systems and pairwise learning for improving detection rates on intrusion detection systems," Expert Systems with Applications, vol. 42, no. 1, pp. 193-202, 2015.   DOI
3 L. M. Ibrahim, D. T. Basheer, and M. S. Mahmod, "A comparison study for intrusion database (Kdd99, Nsl-Kdd) based on self organization map (SOM) artificial neural network," Journal of Engineering Science and Technology, vol. 8, no. 1, pp. 107-119, 2013.
4 W. Feng, Q. Zhang, G. Hu, and J. X. Huang, "Mining network data for intrusion detection through combining SVMs with ant colony networks," Future Generation Computer Systems, vol. 37, pp. 127-140, 2014.   DOI
5 G. B. Huang, Q. Y. Zhu, and C. K. Siew, "Extreme learning machine: theory and applications," Neurocomputing, vol. 70, no. 1-3, pp. 489-501, 2006.   DOI
6 Z. Zhu, Y. S. Ong, and M. Dash, "Wrapper-filter feature selection algorithm using a memetic framework," IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 37, no. 1, pp. 70-76, 2007.   DOI
7 G. B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 42, no. 2, pp. 513-529, 2012.   DOI
8 L. J. Pan, W. Jin, and J. Wu, "A novel intrusion detection approach using multi-kernel functions," Telkomnika, vol. 12, no. 4, pp. 1088-1095, 2014.   DOI
9 R. Jayaprakash and S. Murugappan, "Intrusion detection based on KELM with Levenberg-Marquardt optimization," in Proceedings of 2015 International Conference on Communications and Signal Processing (ICCSP), Melmaruvathur, India, 2015, pp. 0154-0156.
10 V. Jaiganesh and P. Sumathi, "Kernelized extreme learning machine with Levenberg-Marquardt learning approach towards intrusion detection," International Journal of Computer Applications, vol. 54, no. 14, pp. 38-44, 2012.   DOI
11 C. Lazar, J. Taminau, S. Meganck, D. Steenhoff, A. Coletta, C. Molter, et al., "A survey on filter techniques for feature selection in gene expression microarray analysis," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 9, no. 4, pp. 1106-1119, 2012.   DOI
12 C. R. Rao and S. K. Mitra, "Further contributions to the theory of generalized inverse of matrices and its applications," Sankhya: The Indian Journal of Statistics Series A, vol. 33, no. 3, pp. 289-300, 1971.
13 C. L. Huang and C. J. Wang, "A GA-based feature selection and parameters optimization for support vector machines," Expert Systems with Applications, vol. 31, no. 2, pp. 231-240, 2006.   DOI
14 F. Kuang, W. Xu, and S. Zhang, "A novel hybrid KPCA and SVM with GA model for intrusion detection," Applied Soft Computing, vol. 18, pp. 178-184, 2014.   DOI
15 S. W. Lin, K. C. Ying, S. C. Chen, and Z. J. Lee, "Particle swarm optimization for parameter determination and feature selection of support vector machines," Expert Systems with Applications, vol. 35, no. 4, pp. 1817-1824, 2008.   DOI
16 H. Frohlich, O. Chapelle, and B. Scholkopf, "Feature selection for support vector machines by means of genetic algorithm," in Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence, Sacramento, CA, 2003, pp. 142-148.
17 Y. Bao, Z. Hu, and T. Xiong, "A PSO and pattern search based memetic algorithm for SVMs parameters optimization," Neurocomputing, vol. 117, pp. 98-106, 2013.   DOI
18 University of New Brunswick, "NSL-KDD dataset," 2006 [Online]. Available: https://www.unb.ca/cic/datasets/nsl.html.
19 S. Huang, B. Wang, J. Qiu, J. Yao, G. Wang, and G. Yu, "Parallel ensemble of online sequential extreme learning machine based on MapReduce," Neurocomputing, vol. 174, pp. 352-367, 2016.   DOI
20 C. Cheng, W. P. Tay, and G. B. Huang, "Extreme learning machines for intrusion detection," in Proceedings of the 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, Australia, 2012, pp. 1-8.
21 S. W. Lin, K. C. Ying, C. Y. Lee, and Z, J. Lee, "An intelligent algorithm with feature selection and decision rules applied to anomaly intrusion detection," Applied Soft Computing, vol. 12, no. 10, pp. 3285-3290, 2012.   DOI
22 W. Hu, J. Gao, Y. Wang, O. Wu, and S. Maybank, "Online Adaboost-based parameterized methods for dynamic distributed network intrusion detection," IEEE Transactions on Cybernetics, vol. 44, no. 1, pp. 66-82, 2013.   DOI
23 R. Singh, H. Kumar, and R. K. Singla, "An intrusion detection system using network traffic profiling and online sequential extreme learning machine," Expert Systems with Applications, vol. 42, no. 22, pp. 8609-8624, 2015.   DOI
24 Z. Ye and Y. Yu, "Network intrusion classification based on extreme learning machine," in Proceedings of 2015 IEEE International Conference on Information and Automation, Lijiang, China, 2015, pp. 1642-1647.
25 J. M. Fossaceca, T. A. Mazzuchi, and S. Sarkani, "MARK-ELM: application of a novel multiple kernel learning framework for improving the robustness of network intrusion detection," Expert Systems with Applications, vol. 42, no. 8, pp. 4062-4080, 2015.   DOI
26 C. Ma, J. Ouyang, H. L. Chen, and J. C. Ji, "A novel kernel extreme learning machine algorithm based on self-adaptive artificial bee colony optimisation strategy," International Journal of Systems Science, vol. 47, no. 6, pp. 1342-1357, 2016.   DOI
27 A. Onan, S. Korukoglu, and H. Bulut, "A multiobjective weighted voting ensemble classifier based on differential evolution algorithm for text sentiment classification," Expert Systems with Applications, vol. 62, pp. 1-16, 2016.   DOI
28 X. Zhang, X. Chen, and Z. He, "An ACO-based algorithm for parameter optimization of support vector machines," Expert Systems with Applications, vol. 37, no. 9, pp. 6618-6628, 2010.   DOI
29 C. L. Huang and J. F. Dun, "A distributed PSO-SVM hybrid system with feature selection and parameter optimization," Applied Soft Computing, vol. 8, no. 4, pp. 1381-1391, 2008.   DOI
30 R. Ahila, V. Sadasivam, and K. Manimala, "An integrated PSO for parameter determination and feature selection of ELM and its application in classification of power system disturbances," Applied Soft Computing, vol. 32, pp. 23-37, 2015.   DOI
31 J. Kennedy and R. C. Eberhart, "A discrete binary version of the particle swarm algorithm," in Proceedings of 1997 IEEE International Conference on Systems, Man, And Cybernetics: Computational Cybernetics and Simulation, Orlando, FL, 1997, pp. 4104-4108.
32 J. Kennedy and R. Eberhart, "Particle swarm optimization," in Proceedings of International Conference on Neural Networks (ICNN), Perth, Australia, 1995, pp. 1942-1948.
33 M. M. Najafabadi, T. M. Khoshgoftaar, and N. Seliya, "Evaluating feature selection methods for network intrusion detection with Kyoto data," International Journal of Reliability, Quality and Safety Engineering, vol. 23, no. 1, article no. 1650001, 2016. https://doi.org/10.1142/S0218539316500017   DOI
34 The UCI KDD Archive, "KDD Cup 1999 Data," 1999 [Online]. Available: http://kdd.ics.uci.edu/databases/kddcup99/kddcup99.html.
35 Kyoto University, "Traffic data from Kyoto University's Honeypots," 2016 [Online]. Available: https://www.takakura.com/Kyoto_data/.
36 D. S. Kim and J. S. Park, "Network-based intrusion detection with support vector machines," in Information Networking. Heidelberg, Germany: Springer, 2003, pp. 747-756.
37 Y. Shen, K. Zheng, C. Wu, M. Zhang, X. Niu, and Y. Yang, "An ensemble method based on selection using bat algorithm for intrusion detection," The Computer Journal, vol. 61, no. 4, pp. 526-538, 2018.   DOI
38 D. Mladenic, J. Brank, M. Grobelnik, and N. Milic-Frayling, "Feature selection using linear classifier weights: interaction with classification models," in Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, UK, 2004, pp. 234-241.