Browse > Article
http://dx.doi.org/10.3837/tiis.2022.04.003

Improved marine predators algorithm for feature selection and SVM optimization  

Jia, Heming (College of Information Engineering, Sanming University)
Sun, Kangjian (College of Mechanical and Electrical Engineering, Northeast Forestry University)
Li, Yao (College of Mechanical and Electrical Engineering, Northeast Forestry University)
Cao, Ning (College of Information Engineering, Sanming University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.16, no.4, 2022 , pp. 1128-1145 More about this Journal
Abstract
Owing to the rapid development of information science, data analysis based on machine learning has become an interdisciplinary and strategic area. Marine predators algorithm (MPA) is a novel metaheuristic algorithm inspired by the foraging strategies of marine organisms. Considering the randomness of these strategies, an improved algorithm called co-evolutionary cultural mechanism-based marine predators algorithm (CECMPA) is proposed. Through this mechanism, search agents in different spaces can share knowledge and experience to improve the performance of the native algorithm. More specifically, CECMPA has a higher probability of avoiding local optimum and can search the global optimum quickly. In this paper, it is the first to use CECMPA to perform feature subset selection and optimize hyperparameters in support vector machine (SVM) simultaneously. For performance evaluation the proposed method, it is tested on twelve datasets from the university of California Irvine (UCI) repository. Moreover, the coronavirus disease 2019 (COVID-19) can be a real-world application and is spreading in many countries. CECMPA is also applied to a COVID-19 dataset. The experimental results and statistical analysis demonstrate that CECMPA is superior to other compared methods in the literature in terms of several evaluation metrics. The proposed method has strong competitive abilities and promising prospects.
Keywords
Marine predators algorithm; co-evolutionary cultural mechanism; feature selection; support vector machine; hyperparameters optimization;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 E. Emary, H. M. Zawbaa, and A. E. Hassanien, "Binary ant lion approaches for feature selection," Neurocomputing, vol. 213, pp. 54-65, Nov. 2016.   DOI
2 UCI Machine Learning Repository. Accessed: Jan. 4, 2021. [Online]. Available: http://archive.ics.uci.edu/ml/index.php.
3 J. Derrac, S. Garcia, D. Molina, F. Herrera, "A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms," Swarm and Evolutionary Computation, vol. 1, no. 1, pp. 3-18, 2011.   DOI
4 P. H. Thike, Z. Zhao, P. Liu, F. Bao, and Y. Jin, "An early stopping-based artificial neural network model for atmospheric corrosion prediction of carbon steel," Computers, Materials & Continua, vol. 65, no. 3, pp. 2091-2109, 2020.   DOI
5 K. Sun, H. Jia, Y. Li, and Z. Jiang, "Hybrid Improved Slime Mould Algorithm with Adaptive β Hill Climbing for Numerical Optimization," Journal of Intelligent & Fuzzy Systems, vol. 40, no. 1, pp. 1667-1679, Jan. 2021.   DOI
6 M.R. Gauthama Raman, N. Somu, K. Kirthivasan, R. Liscano, and V.S. Shankar Sriram, "An efficient intrusion detection system based on hypergraph - Genetic algorithm for parameter optimization and feature selection in support vector machine," Knowledge-Based Systems, vol. 134, pp. 1-12, Oct. 2017.   DOI
7 C. Huang, and J. Dun, "A distributed PSO-SVM hybrid system with feature selection and parameter optimization," Applied Soft Computing, vol. 8, no. 4, pp. 1381-1391, Sep. 2008.   DOI
8 S.P. Das, and S. Padhy, "A novel hybrid model using teaching-learning-based optimization and a support vector machine for commodity futures index forecasting," International Journal of Machine Learning and Cybernetics, vol. 9, pp. 97-111, 2018.   DOI
9 C. Iwendi, A.K. Bashir, A. Peshkar, R. Sujatha, J.M. Chatterjee, S. Pasupuleti, R. Mishra, S. Pillai, and O. Jo, "COVID-19 patient health prediction using boosted random forest algorithm," Frontiers in Public Health, vol. 8, Jul. 2020.
10 B. Liu, H. Ma, and X. Zhang, "A Co-evolutionary Differential Evolution Algorithm for Constrained Optimization," in Proc. of Third International Conference on Natural Computation (ICNC 2007), pp. 51-57, 2007.
11 Y. Zheng, "Decision tree algorithm for precision marketing via network channel," Computer Systems Science and Engineering, vol. 35, no. 4, pp. 293-298, 2020.   DOI
12 S. Baliarsingh, W. Ding, S. Vipsita, and S. Bakshi, "A memetic algorithm using emperor penguin and social engineering optimization for medical data classification," Applied Soft Computing, vol. 85, pp. 105773, 2019.   DOI
13 M.M. Mafarja, and S. Mirjalili, "Hybrid Whale Optimization Algorithm with simulated annealing for feature selection," Neurocomputing, vol. 260, pp. 302-312, Oct. 2017.   DOI
14 The COVID-19 dataset. Accessed: Jan. 4, 2021. [Online]. Available: https://github.com/Atharva-Peshkar/Covid-19-Patient-Health-Analytics.
15 I. Aljarah, A.M. Al-Zoubi, H. Faris, M.A. Hassonah, S. Mirjalili, and H. Saadeh, "Simultaneous Feature Selection and Support Vector Machine Optimization Using the Grasshopper Optimization Algorithm," Cognitive Computation, vol. 10, pp. 478-495, 2018.   DOI
16 M. Shafiq, Z. Tian, A. K. Bashir, A. Jolfaei, and X. Yu, "Data mining and machine learning methods for sustainable smart cities traffic classification: A survey," Sustainable Cities and Society, vol. 60, pp. 102177, Sep. 2020.   DOI
17 A. U. Haq, J. Li, A. Saboor, J. Khan, S. Wali, S. Ahmad, A. Ali, G. A. Khan, and W. Zhou, "Detection of Breast Cancer Through Clinical Data Using Supervised and Unsupervised Feature Selection Techniques," IEEE Access, vol. 9, pp. 22090-22105, 2021.   DOI
18 G. A. Khan, J. Hu, T. Li, B. Diallo, and Q. Huang, "Weighted Multi-View Data Clustering via Joint Non-Negative Matrix Factorization," in Proc. of 2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), pp. 1159-1165, 2019.
19 K. Zhu, N. Zhang, S. Ying, and X. Wang, "Within-project and cross-project software defect prediction based on improved transfer naive bayes algorithm," Computers, Materials & Continua, vol. 63, no. 2, pp. 891-910, 2020.
20 C. Zhang, J. Yao, G. Hu, and T. Schott, "Applying feature-weighted gradient decent k-nearest neighbor to select promising projects for scientific funding," Computers, Materials & Continua, vol. 64, no. 3, pp. 1741-1753, 2020.   DOI
21 A. N. Khan, H. Nazarian, N. A. Golilarz, A. Addeh, J. P. Li, and G. A. Khan, "Brain Tumor Classification Using Efficient Deep Features of MRI Scans and Support Vector Machine," in Proc. of 2020 17th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), pp. 314-318, 2020.
22 C. Cortes, V. Vapnik, "Support-vector networks," Machine learning, vol. 20, pp. 273-297, 1995.   DOI
23 G. P. Nam, B. J. Kang, and K. R. Park, "Robustness of Face Recognition to Variations of Illumination on Mobile Devices Based on SVM," KSII Transactions on Internet and Information Systems, vol. 4, no. 1, pp. 25-44, 2010.   DOI
24 M. A. Elaziz, A. A. Ewees, D. Yousri, H. S. N. Alwerfali, Q. A. Awad, S. Lu, and M. A. A. Al-Qaness, "An Improved Marine Predators Algorithm With Fuzzy Entropy for Multi-level Thresholding: Real World Example of COVID-19 CT Image Segmentation," IEEE Access, vol. 8, pp. 125306-125330, 2020.   DOI
25 Y. Xue, T. Tang, W. Pang, and A. X. Liu, "Self-adaptive parameter and strategy based particle swarm optimization for large-scale feature selection problems with multiple classifiers," Applied Soft Computing, vol. 88, pp. 106031, 2020.   DOI
26 Y. Liu, and D. Pi, "A Novel Kernel SVM Algorithm with Game Theory for Network Intrusion Detection," KSII Transactions on Internet and Information Systems, vol. 11, no. 8, pp. 4043-4060, 2017.   DOI
27 Y. He, I. Ahmad, L. Shi, and K. Chang, "SVM-based Drone Sound Recognition using the Combination of HLA and WPT Techniques in Practical Noisy Environment," KSII Transactions on Internet and Information Systems, vol. 13, no. 10, pp. 5078-5094, 2019.   DOI
28 R. Chen, C. Hsieh, "Web page classification based on a support vector machine using a weighted vote schema," Expert Systems with Applications, vol. 31, no. 2, pp. 427-435, 2006.   DOI
29 A. Faramarzi, M. Heidarinejad, S. Mirjalili, and A. H. Gandomi, "Marine Predators Algorithm: A nature-inspired metaheuristic," Expert Systems with Applications, vol. 152, pp. 113377, Aug. 2020.   DOI
30 H. Jia, K. Sun, W. Song, X. Peng, C. Lang, and Y. Li, "Multi-Strategy Emperor Penguin Optimizer for RGB Histogram-Based Color Satellite Image Segmentation Using Masi Entropy," IEEE Access, vol. 7, pp. 134448-134474, 2019.   DOI
31 M.A.A. Al-qaness, A.A. Ewees, H. Fan, L. Abualigah, and M. Abd Elaziz, "Marine Predators Algorithm for Forecasting Confirmed Cases of COVID-19 in Italy, USA, Iran and Korea," International Journal of Environmental Research and Public Health, vol. 17, no. 10, pp. 3520, 2020.   DOI
32 K. Zhong, Q. Luo, Y. Zhou, and M. Jiang, "TLMPA: Teaching-learning-based Marine Predators algorithm," AIMS Mathematics, vol. 6, no. 2, pp. 1395-1442, 2021.
33 D. Wolpert, "No free lunch theorems for optimization," IEEE Transactions on Evolutionary Computation, vol. 1, no. 1, pp. 67-82, 1997.   DOI
34 R.G. Reynolds, "An Introduction to Cultural Algorithms," in Proc. of the Third Annual Conference on Evolutionary Programming, pp. 131-139, Feb. 1994.
35 H. Jia, Z. Xing, and W. Song, "A New Hybrid Seagull Optimization Algorithm for Feature Selection," IEEE Access, vol. 7, pp. 49614-49631, 2019.   DOI
36 A.M. Al-Zoubi, A.A. Heidari, M. Habib, H. Faris, I. Aljarah, and M.A. Hassonah, "Salp Chain-Based Optimization of Support Vector Machines and Feature Weighting for Medical Diagnostic Information Systems," Evolutionary Machine Learning Techniques, pp. 11-34, 2020.
37 E. H. Houssein, M. E. Hosney, D. Oliva, W. M. Mohamed, and M. Hassaballah, "A novel hybrid Harris hawks optimization and support vector machines for drug design and discovery," Computers & Chemical Engineering, vol. 133, pp. 106656, 2020.   DOI
38 Y. Sun, L. Zhang, and X. Gu, "A hybrid co-evolutionary cultural algorithm based on particle swarm optimization for solving global optimization problems," Neurocomputing, vol. 98, pp. 76-89, Dec. 2012.   DOI
39 C. Chang, and C. Lin, "LIBSVM: a library for support vector machines," ACM Transactions on Intelligent Systems and Technology, vol. 2, no. 3, pp. 1-27, Apr. 2011.   DOI