An Improved Grey Wolf Optimization-Based Learning of Artificial Neural Network for Medical Data Classification
DOI:
https://doi.org/10.32890/jict2021.20.2.9Keywords:
Metaheuristic, Medical Diagnosis, Grey Wolf Optimization, Artificial Neural Network, Multilayer Perceptron, Particle Swarm OptimizationAbstract
Grey wolf optimization (GWO) is a recent and popular swarm-based metaheuristic approach. It has been used in numerous fields such as numerical optimization, engineering problems, and machine learning. The different variants of GWO have been developed in the last 5 years for solving optimization problems in diverse fields. Like other metaheuristic algorithms, GWO also suffers from local optima and slow convergence problems, resulted in degraded performance. An adequate equilibrium among exploration and exploitation is a key factor to the success of meta-heuristic algorithms especially for optimization task. In this paper, a new variant of GWO, called inertia motivated GWO (IMGWO) is proposed. The aim of IMGWO is to establish better balance between exploration and exploitation. Traditionally, artificial neural network (ANN) with backpropagation (BP) depends on initial values and in turn, attains poor convergence. The metaheuristic approaches are better alternative instead of BP. The proposed IMGWO is used to train the ANN to prove its competency in terms of prediction. The proposed IMGWO-ANN is used for medical diagnosis task. Some benchmark medical datasets including heart disease, breast cancer, hepatitis, and parkinson's diseases are used for assessing the performance of IMGWO-ANN. The performance measures are described in terms of mean squared errors (MSEs), classification accuracies, sensitivities, specificities, the area under the curve (AUC), and receiver operating characteristic (ROC) curve. It is found that IMGWO outperforms than three popular metaheuristic approaches including GWO, genetic algorithm (GA), and particle swarm optimization (PSO). Results confirmed the potency of IMGWO as a viable learning technique for an ANN.
References
Akay, M. F. (2009). Support vector machines combined with feature selection for breast cancer diagnosis. Expert Systems with Applications, 36(2), (Part 2), 3240–3247. https://doi.org/10.1016/j.eswa.2008.01.009
AlMuhaideb, S., & Menai, M. E. B. (2014). HColonies: A new hybrid metaheuristic for medical data classification. Applied Intelligence, 41(1), 282–298. https://doi.org/10.1007/s10489-014-0519-z
Altay, E. V., & Alatas, B. (2020). Association analysis of Parkinson disease with vocal change characteristics using multi-objective metaheuristic optimization. Medical Hypotheses, 141, 109722. https://doi.org/10.1016/j.mehy.2020.109722
Amirsadri, S., Mousavirad, S. J., & Ebrahimpour-Komleh, H. (2018). A Levy flight-based grey wolf optimizer combined with back-propagation algorithm for neural network training. Neural Computing and Applications, 30(12), 3707–3720. https://doi.org/10.1007/s00521-017-2952-5
Bascil, M. S., & Temurtas, F. (2011). A study on hepatitis disease diagnosis using multilayer neural network with Levenberg Marquardt training algorithm. Journal of Medical Systems, 35(3), 433–436. https://doi.org/10.1007/s10916-009-9378-2 Journal of ICT, 20, No. 2 (April) 2021, pp: 213–
Bhardwaj, A., & Tiwari, A. (2015). Breast cancer diagnosis using genetically optimized neural network model. Expert Systems with Applications, 42(10), 4611–4620. https://doi.org/10.1016/j.eswa.2015.01.065
Blum, C., & Socha, K. (2005). Training feed-forward neural networks with ant colony optimization: An application to pattern classification. In Fifth International Conference on Hybrid Intelligent Systems (HIS’05) (pp. 6-pp.). https://doi.org/10.1109/ichis.2005.104
Brameier, M., & Banzhaf, W. (2001). Evolving teams of predictors with linear genetic programming. Genetic Programming and Evolvable Machines, 2(4), 381–407. https://doi.org/10.1023/A:1012978805372
Brent, R. P. (1991). Fast training algorithms for multilayer neural nets. IEEE Transactions on Neural Networks, 2(3), 346–354. https://doi.org/10.1109/72.97911
Cai, Z., Gu, J., Wen, C., Zhao, D., Huang, C., Huang, H., Tong, C., Li, J., & Chen, H. (2018). An intelligent Parkinson’s disease diagnostic system based on a chaotic bacterial foraging optimization enhanced fuzzy KNN approach. Computational and Mathematical Methods in Medicine, 2018. https://doi.org/10.1155/2018/2396952
Chatterjee, A., & Siarry, P. (2006). Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization. Computers & Operations Research, 33(3), 859–871. https://doi.org/10.1016/j.cor.2004.08.012
Chen, H.-L., Liu, D.-Y., Yang, B., Liu, J., & Wang, G. (2011). A new hybrid method based on local fisher discriminant analysis and support vector machines for hepatitis disease diagnosis. Expert Systems with Applications, 38(9), 11796–11803. https://doi.org/10.1016/j.eswa.2011.03.066
Das, G., Pattnaik, P. K., & Padhy, S. K. (2014). Artificial neural network trained by particle swarm optimization for non-linear channel equalization. Expert Systems with Applications, 41(7), 3491–3496. https://doi.org/10.1016/j.eswa.2013.10.053
Das, R., Turkoglu, I., & Sengur, A. (2009). Effective diagnosis of heart disease through neural networks ensembles. Expert Systems with Applications, 36(4), 7675–7680. https://doi.org/10.1016/j. eswa.2008.09.013
Das, S., Mishra, S., & Senapati, M. R. (2020). New approaches in metaheuristic to classify medical data using artificial neural Journal of ICT, 20, No. 2 (April) 2021, pp: 213-network. Arabian Journal for Science and Engineering, 45(4), 2459–2471. https://doi.org/10.1007/s13369-019-04026-y
Ding, S., Su, C., & Yu, J. (2011). An optimizing BP neural network algorithm based on genetic algorithm. Artificial Intelligence Review, 36(2), 153–162. https://doi.org/10.1007/s10462-011-9208-z
Djema, M. A., Boudour, M., Agbossou, K., Cardenas, A., & Doumbia, M. L. (2019). Adaptive direct power control based on ANN-GWO for grid interactive renewable energy systems with an improved synchronization technique. International Transactions on Electrical Energy Systems, 29(3), e2766. https://doi.org/10.1002/etep.2766
Emary, E., Zawbaa, H. M., & Grosan, C. (2018). Experienced gray wolf optimization through reinforcement learning and neural networks. IEEE Transactions on Neural Networks and Learning Systems, 29(3), 681–694. https://doi.org/10.1109/ TNNLS.2016.2634548
Emary, E., Zawbaa, H. M., & Hassanien, A. E. (2016). Binary grey wolf optimization approaches for feature selection. Neurocomputing, 172, 371–381. https://doi.org/10.1016/j. neucom.2015.06.083
Garro, B. A., Sossa, H., & Vazquez, R. A. (2011). Artificial neural network synthesis by means of artificial bee colony (ABC) algorithm. In 2011 IEEE Congress of Evolutionary Computation (CEC) (pp. 331–338). https://doi.org/10.1109/ CEC.2011.5949637
Gori, M., & Tesi, A. (1992). On the problem of local minima in backpropagation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(1), 76–86. https://doi.org/10.1109/34.107014
Green, R. C., Wang, L., & Alam, M. (2012). Training neural networks using central force optimization and particle swarm optimization: Insights and comparisons. Expert Systems with Applications, 39(1), 555–563. https://doi.org/10.1016/j. eswa.2011.07.046
Gudise, V. G., & Venayagamoorthy, G. K. (2003). Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks. In Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS’03 (Cat. No.03EX706) (pp. 110–117). IEEE. https://doi.org/10.1109m/ SIS.2003.1202255 Journal of ICT, 20, No. 2 (April) 2021, pp: 213–
Haykin, S. (1994). Neural networks: A comprehensive foundation (1st ed.). Prentice Hall PTR.
Huang, H., Feng, X., Zhou, S., Jiang, J., Chen, H., Li, Y., & Li, C. (2019). A new fruit fly optimization algorithm enhanced support vector machine for diagnosis of breast cancer based on high-level features. BMC Bioinformatics, 20(8), 290. https://doi.org/10.1186/s12859-019-2771-z
Irani, R., & Nasimi, R. (2011). Evolving neural network using real coded genetic algorithm for permeability estimation of the reservoir. Expert Systems with Applications, 38(8), 9862–9866. https://doi.org/10.1016/j.eswa.2011.02.046
Karaboga, D., Akay, B., & Ozturk, C. (2007). Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks. In V. Torra, Y. Narukawa, & Y. Yoshida (Eds.), Modeling Decisions for Artificial Intelligence (Vol. 4617, pp. 318–329). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-73729-2_30
Khairuzzaman, A. K. M., & Chaudhury, S. (2017). Multilevel thresholding using grey wolf optimizer for image segmentation. Expert Systems with Applications, 86, 64–76. https://doi.org/10.1016/j.eswa.2017.04.029
Kulluk, S., Ozbakir, L., & Baykasoglu, A. (2012). Training neural networks with harmony search algorithms for classification problems. Engineering Applications of Artificial Intelligence, 25(1), 11–19. https://doi.org/10.1016/j.engappai.2011.07.006
Latha, C. B. C., & Jeeva, S. C. (2019). Improving the accuracy of prediction of heart disease risk based on ensemble classification techniques. Informatics in Medicine Unlocked, 16, 100203. https://doi.org/10.1016/j.imu.2019.100203
Li, Q., Chen, H., Huang, H., Zhao, X., Cai, Z., Tong, C., Liu, W., & Tian, X. (2017). An enhanced grey wolf optimization based feature selection wrapped kernel extreme learning machine for medical diagnosis. Computational and Mathematical Methods in Medicine, 2017, 1–15. https://doi.org/10.1155/2017/9512741
Lin, R.-H., & Chuang, C.-L. (2010). A hybrid diagnosis model for determining the types of the liver disease. Computers in Biology and Medicine, 40(7), 665–670. https://doi.org/10.1016/j. compbiomed.2010.06.002
Long, W., Jiao, J., Liang, X., & Tang, M. (2018). Inspired grey wolf optimizer for solving large-scale function optimization problems. Applied Mathematical Modelling, 60, 112–126. https://doi.org/10.1016/j.apm.2018.03.005 Journal of ICT, 20, No. 2 (April) 2021, pp: 213-
Long, W., Liang, X., Cai, S., Jiao, J., & Zhang, W. (2017). A modified augmented Lagrangian with improved grey wolf optimization to constrained optimization problems. Neural Computing and Applications, 28(S1), 421–438. https://doi.org/10.1007/ s00521-016-2357-x
Maglogiannis, I., Loukis, E., Zafiropoulos, E., & Stasis, A. (2009). Support vectors machine-based identification of heart valve diseases using heart sounds. Computer Methods and Programs in Biomedicine, 95(1), 47–61. https://doi.org/10.1016/j. cmpb.2009.01.003
Mendes, R., Cortez, P., Rocha, M., & Neves, J. (2002). Particle swarms for feedforward neural network training. In Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN’02 (Cat. No.02CH37290) (Vol. 2, pp. 1895–1899). IEEE. https://doi.org/10.1109/ijcnn.2002.1007808
Mirjalili, Seyedali. (2015). How effective is the grey wolf optimizer in training multi-layer perceptrons. Applied Intelligence, 43(1), 150–161. https://doi.org/10.1007/s10489-014-0645-7
Mirjalili, Seyedali, Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007
Mirjalili, Seyedali, Mirjalili, S. M., & Lewis, A. (2014). Let a biogeography-based optimizer train your multi-layer perceptron. Information Sciences, 269, 188–209. https://doi.org/10.1016/j.ins.2014.01.038
Mirjalili, SeyedAli, MohdHashim, S. Z., & MoradianSardroudi, H. (2012). Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm. Applied Mathematics and Computation, 218(22), 11125–11137. https://doi.org/10.1016/j.amc.2012.04.069
Nosratabadi, S., Szell, K., & Beszedes, B. (2020). Comparative analysis of ANN-ICA and ANN-GWO for crop yield prediction. 5.
Ojha, V. K., Abraham, A., & Snášel, V. (2017). Metaheuristic design of feedforward neural networks: A review of two decades of research. Engineering Applications of Artificial Intelligence, 60, 97–116. https://doi.org/10.1016/j.engappai.2017.01.013
Oliva, D., & Hinojosa, S. (Eds.). (2020). Applications of hybrid metaheuristic algorithms for image processing (Vol. 890). Springer International Publishing. https://doi.org/10.1007/978-3-030-40977-7 Journal of ICT, 20, No. 2 (April) 2021, pp: 213–
Pereira, L. A. M., Rodrigues, D., Ribeiro, P. B., Papa, J. P., & Weber, S. A. T. (2014). Social-spider optimization-based artificial neural networks training and its applications for Parkinson’s disease identification. In 2014 IEEE 27th International Symposium on Computer-Based Medical Systems (pp. 14–17). https://doi.org/10.1109/CBMS.2014.25
Pham, H. N. A., & Triantaphyllou, E. (2009). An application of a new meta-heuristic for optimizing the classification accuracy when analyzing some medical datasets. Expert Systems with Applications, 36(5), 9240–9249. https://doi.org/10.1016/j. eswa.2008.12.007
Qais, M. H., Hasanien, H. M., &Alghuwainem, S. (2018). Augmented grey wolf optimizer for grid-connected PMSG-based wind energy conversion systems. Applied Soft Computing, 69, 504–515. https://doi.org/10.1016/j.asoc.2018.05.006
Sahoo, A., & Chandra, S. (2017). Multi-objective grey wolf optimizer for improved cervix lesion classification. Applied Soft Computing, 52, 64–80. https://doi.org/10.1016/j. asoc.2016.12.022
Sarangi, P. P., Sahu, A., & Panda, M. (2014). Training a feed-forward neural network using artificial bee colony with back-propagation algorithm. In D. P. Mohapatra & S. Patnaik (Eds.), Intelligent Computing, Networking, and Informatics (Vol. 243, pp. 511–519). Springer India. https://doi.org/10.1007/978-81-322-1665-0_49
Saremi, S., Mirjalili, S. Z., & Mirjalili, S. M. (2015). Evolutionary population dynamics and grey wolf optimizer. Neural Computing and Applications, 26(5), 1257–1263. https://doi.org/10.1007/s00521-014-1806-7
Sarkar, D., & Modak, J. M. (2003). ANNSA: A hybrid artificial neural network/simulated annealing algorithm for optimal control problems. Chemical Engineering Science, 58(14), 3131–3142. https://doi.org/10.1016/S0009-2509(03)00168-4
Sartakhti, J. S., Zangooei, M. H., & Mozafari, K. (2012). Hepatitis disease diagnosis using a novel hybrid method based on support vector machine and simulated annealing (SVM-SA). Computer Methods and Programs in Biomedicine, 108(2), 570–579. https://doi.org/10.1016/j.cmpb.2011.08.003
Seiffert, U. (2001). Multiple layer perceptron training using genetic algorithms. In European Symposium on Artificial Neural Networks (ESANN) (pp. 159–164). Journal of ICT, 20, No. 2 (April) 2021, pp: 213-
Shariati, M., Mafipour, M. S., Mehrabi, P., Bahadori, A., Zandi, Y., Salih, M. N. A., Nguyen, H., Dou, J., Song, X., & Poi-Ngian, S. (2019). Application of a hybrid artificial neural network-particle swarm optimization (ANN-PSO) model in behavior prediction of channel shear connectors embedded in normal and high-strength concrete. Applied Sciences, 9(24), 5534. https://doi.org/10.3390/app9245534
Shen, L., Chen, H., Yu, Z., Kang, W., Zhang, B., Li, H., Yang, B., & Liu, D. (2016). Evolving support vector machines using fruit fly optimization for medical data classification. Knowledge-Based Systems, 96, 61–75. https://doi.org/10.1016/j. knosys.2016.01.002
Shi, Y., & Eberhart, R. (1998). A modified particle swarm optimizer. In 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360) (pp. 69–73). https://doi.org/10.1109/icec.1998.699146
Slowik, A. (2011). Application of an adaptive differential evolution algorithm with multiple trial vectors to artificial neural network training. IEEE Transactions on Industrial Electronics, 58(8), 3160–3167. https://doi.org/10.1109/tie.2010.2062474
Tay, D., Poh, C. L., Goh, C., & Kitney, R. I. (2014). A biological continuum based approach for efficient clinical classification. Journal of Biomedical Informatics, 47, 28–38. https://doi.org/10.1016/j.jbi.2013.09.002
Tong, D. L., & Mintram, R. (2010). Genetic algorithm-neural network (GANN): A study of neural network activation functions and depth of genetic algorithm search applied to feature selection. International Journal of Machine Learning and Cybernetics, 1(1), 75–87. https://doi.org/10.1007/s13042-010-0004-x
Turabieh, H. (2016). A hybrid ANN-GWO algorithm for prediction of heart disease. American Journal of Operations Research, 06(02), 136–146. https://doi.org/10.4236/ajor.2016.62016
Uzlu, E., Kankal, M., Akpınar, A., & Dede, T. (2014). Estimates of energy consumption in Turkey using neural networks with the teaching–learning-based optimization algorithm. Energy, 75, 295–303. https://doi.org/10.1016/j.energy.2014.07.078
Yan, H., Jiang, Y., Zheng, J., Peng, C., & Li, Q. (2006). A multilayer perceptron-based medical decision support system for heart disease diagnosis. Expert Systems with Applications, 30(2), 272–281. https://doi.org/10.1016/j.eswa.2005.07.022 Journal of ICT, 20, No. 2 (April) 2021, pp: 213–
Zhang, J.-R., Zhang, J., Lok, T.-M., & Lyu, M. R. (2007). A hybrid particle swarm optimization–back-propagation algorithm for feedforward neural network training. Applied Mathematics and Computation, 185(2), 1026–1037. https://doi.org/10.1016/j. amc.2006.07.025
Zhang, Y., Jin, Z., & Chen, Y. (2019). Hybridizing grey wolf optimization with neural network algorithm for global numerical optimization problems. Neural Computing and Applications. https://doi.org/10.1007/s00521-019-04580-4
Published
Issue
Section
How to Cite
Research impact
Harvested 2026-09-06Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
- OpenCitations 0 View →
- Crossref 0 View →
- Scopus 0 not indexed View →
- Google Scholar no free count Search →
- Dimensions no free count Search →
2002 - 2020
