Impact of Balanced Exploration and Exploitation on High-dimensional Feature Selection with Hierarchical Whale Optimisation Algorithm
DOI:
https://doi.org/10.32890/jict2024.23.4.2Keywords:
Balancing exploration and exploitation, control parameter, feature selection, stability, whale optimisation algorithmAbstract
High-dimensional datasets (HDDs) pose significant challenges in feature selection due to their complex nature. While metaheuristic algorithms like the Whale Optimisation Algorithm (WOA) have shown promise in addressing these challenges, stability issues are least addressed. Through an extensive literature review, it was identified that stability is manifested in the equilibrium of exploration and exploitation. Hence, this study introduced the Hierarchical Whale Optimisation Algorithm (HiWOA), an approach designed to enhance the WOA’s stability and performance in HDD feature selection tasks. The HiWOA incorporates a two-phase strategy comprising a nonlinear control parameter based on the arcsine function and a hierarchical position-update mechanism adapted from the Grey Wolf Optimiser. The proposed HiWOA was evaluated through 23 benchmark optimisation functions and feature selection experiments on 11 medical HDDs. The results indicate that the HiWOA outperformed the WOA and a modified variant (mWOA) in terms of a better fitness value, a more balanced exploration-exploitation ratio, and improved classification accuracy with fewer selected features. These findings demonstrate the HiWOA’s effectiveness in enhancing stability, making it a robust solution for high-dimensional optimisation and feature selection.
References
Basir, M. A., Yusof, Y., & Saifullah, M. (2019).
Basir, M. A., Yusof, Y., & Hussin, M. S. (2019). Optimisation of attribute selection model using bio-inspired algorithms. Journal of Information and Communication Technology, 18(1), 35-55. https://doi.org/10.32890/jict2019.18.1.3
Blake, C. L., & Merz, C. J. (1998). UCI Machine Learning Repository. https://archive.ics.uci.edu/ml/index.php Journal of ICT, 23, No. 4 (October) 2024, pp: 593-
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2016). Feature selection for high-dimensional data. Progress in Artificial Intelligence, 5, 65-75. https://doi.org/10.1007/978-3-319-21858-8
Cheng, S., Zhang, M. M., Shi, Y. H., Lu, H., Lei, X. J., & Wang, R. (2023). Generalised pigeon-inspired optimisation algorithm for balancing exploration and exploitation. Zhongguo Kexue Jishu Kexue/Scientia Sinica Technologica, 53(2), 268–279. https://doi.org/10.1360/SST-2021-0371
Debata, P. P., & Mohapatra, P. (2021). Selection of informative genes from high-dimensional cancerous data employing an improvised meta-heuristic algorithm. Evolutionary Intelligence, 0123456789. https://doi.org/10.1007/s12065-021-00593-y
Elmogy, A., Miqrish, H., Elawady, W., & El-Ghaish, H. (2023). ANWOA: An adaptive nonlinear whale optimisation algorithm for high-dimensional optimisation problems. Neural Computing and Applications, 35(30), 22671–22686. https://doi.org/10.1007/s00521-023-08917-y
Han, C., Ranjun, W., Cheng, T., Liu, Z., & Wei, S. (2023). The stability analysis of particle swarm optimisation-grey wolf optimisation algorithm. In A. Bhattacharjya & X. Feng (Eds.), International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2023) (p. 164). SPIE. https://doi.org/10.1117/12.2681160
Hasan, S. N. S., Jamil, N. W., & Ahmat, H. (2023). A review of dimension reduction techniques for classification on high-dimensional data. AIP Conference Proceedings, 2896(1). https://doi.org/10.1063/5.0177327/2922033
Hussain, K., Salleh, M. N. M., Cheng, S., & Shi, Y. (2019). On the exploration and exploitation in popular swarm-based metaheuristic algorithms. Neural Computing and Applications, 31(11), 7665–7683. https://doi.org/10.1007/s00521-018-3592-0
Kazerani, R. (2024). Improving breast cancer diagnosis accuracy by Particle Swarm Optimisation feature selection. International Journal of Computational Intelligence Systems, 17(1), 44. https://doi.org/10.1007/s44196-024-00428-5
Khaire, U. M., & Dhanalakshmi, R. (2022). Stability investigation of improved Whale Optimisation Algorithm in the process of feature selection. IETE Technical Review (Institution of Electronics and Telecommunication Engineers, India), 39(2), 286–300. https://doi.org/10.1080/02564602.2020.1843554 Journal of ICT, 23, No. 4 (October) 2024, pp: 593-
Kumar, N., & Kumar, D. (2021). An improved grey wolf optimisation-based learning of artificial neural network for medical data classification. Journal of Information and Communication Technology, 20(2), 213-248. https://doi.org/10.32890/ jict2021.20.2.4
Li, X., Wang, J., Liu, Y., Song, H., Wang, Y., Hou, J.-N., Zhang, M., & Hao, W.-K. (2024). Classification feature selection and dimensionality reduction based on logical binary sine-cosine function arithmetic optimisation algorithm. Egyptian Informatics Journal, 26, 100472. https://doi.org/10.1016/j. eij.2024.100472
Li, Y., Li, W., Yuan, Q., Shi, H., & Han, M. (2023). Multi-strategy improved Seagull Optimisation algorithm. International Journal of Computational Intelligence Systems, 16(1). https://doi.org/10.1007/s44196-023-00336-0
Liu, G., Guo, Z., Liu, W., Cao, B., Chai, S., & Wang, C. (2023). MSHHOTSA: A variant of tunicate swarm algorithm combining multi-strategy mechanism and hybrid Harris optimisation. PLoS ONE, 18(8 August). https://doi.org/10.1371/journal. pone.0290117
Mirjalili, S., & Lewis, A. (2016). The Whale Optimisation Algorithm. Advances in Engineering Software, 95, 51–67. https://doi.org/10.1016/j.advengsoft.2016.01.008
Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey Wolf Optimiser. Advances in Engineering Software, 69, 46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007
Mohammed, H., & Rashid, T. (2020). A novel hybrid GWO with WOA for global numerical optimisation and solving pressure vessel design. Neural Computing and Applications, 32(18), 14701–14718. https://doi.org/10.1007/s00521-020-04823-9
Nadimi-Shahraki, M. H., Zamani, H., Asghari Varzaneh, Z., & Mirjalili, S. (2023). A systematic review of the Whale Optimisation algorithm: Theoretical foundation, improvements, and hybridisations. Archives of Computational Methods in Engineering, 30(7), 4113–4159. https://doi.org/10.1007/ s11831-023-09928-7
Nirmal, A., Jayaswal, D., & Kachare, P. H. (2024). A Hybrid Bald Eagle-Crow Search Algorithm for Gaussian mixture model optimisation in the speaker verification framework. Decision Analytics Journal, 10. https://doi.org/10.1016/j. dajour.2023.100385 Journal of ICT, 23, No. 4 (October) 2024, pp: 593-
Rajwar, K., Deep, K., & Das, S. (2023). An exhaustive review of the metaheuristic algorithms for search and optimisation: Taxonomy, applications, and open challenges. Artificial Intelligence Review, 56(11), 13187–13257. https://doi.org/10.1007/s10462-023-10470-y
Reddy, K., & Saha, A. K. (2022). A modified Whale Optimisation algorithm for exploitation capability and stability enhancement. Heliyon, 8(10), e11027. https://doi.org/10.1016/j.heliyon.2022. e11027
Shehab, M., Khader, A. T., & Laouchedi, M. (2018). A hybrid method based on Cuckoo Search algorithm for global optimisation problems. Journal of Information and Communication Technology, 17(3), 469-491. https://doi.org/10.32890/ jict2018.17.3.8261
Tan, W. H., & Mohamad-Saleh, J. (2023). A hybrid Whale Optimisation algorithm based on equilibrium concept. Alexandria Engineering Journal, 68, 763–786. https://doi.org/10.1016/j. aej.2022.12.019
Theng, D., & Bhoyar, K. K. (2023). Feature selection techniques for machine learning: A survey of more than two decades of research. Knowledge and Information Systems, 66(3), 1575-1637. https://doi.org/10.1007/s10115-023-02010-5
Tiwari, A., & Chaturvedi, A. (2022). A hybrid feature selection approach based on information theory and dynamic butterfly optimisation algorithm for data classification. Expert Systems with Applications, 196. https://doi.org/10.1016/j. eswa.2022.116621
Tzanetos, A., & Dounias, G. (2021). Exploration and exploitation analysis for the sonar inspired optimisation algorithm. Annals of Mathematics and Artificial Intelligence, 89(8–9), 857–874. https://doi.org/10.1007/s10472-021-09755-1
Wang, F., Feng, S., Pan, Y., Zhang, H., Bi, S., & Zhang, J. (2023). Dynamic spiral updating whale optimisation algorithm for solving optimal power flow problem. Journal of Supercomputing, 79(17), 19959–20000. https://doi.org/10.1007/s11227-023-05427-5
Wang, Y., Ran, S., & Wang, G.-G. (2024). Role-oriented binary grey wolf optimiser using foraging-following and Lévy flight for feature selection. Applied Mathematical Modelling, 126, 310–326. https://doi.org/10.1016/j.apm.2023.08.043
Wang, Z., Zhou, Y., Takagi, T., Song, J., Tian, Y. S., & Shibuya, T. (2023). Genetic algorithm-based feature selection with Journal of ICT, 23, No. 4 (October) 2024, pp: 593-manifold learning for cancer classification using microarray data. BMC Bioinformatics, 24(1). https://doi.org/10.1186/ s12859-023-05267-3
Wu, X., Zhang, S., Xiao, W., & Yin, Y. (2019). The exploration/ exploitation tradeoff in Whale Optimisation algorithm. IEEE Access, 7, 125919–125928. https://doi.org/10.1109/ ACCESS.2019.2938857
Yab, L. Y., Wahid, N., & Hamid, R. A. (2024). Improved ozone level detection through feature selection with modified Whale Optimisation algorithm. Qubahan Academic Journal, 4(1), 265–276. https://doi.org/10.48161/qaj.v4n1a466
Yab, L. Y., Wahid, N., & Hamid, R. A. (2022). A modified Whale Optimisation algorithm as filter-based feature selection for high dimensional datasets. In Lecture Notes in Networks and Systems: Vol. 457 LNNS. https://doi.org/10.1007/978-3-031-00828-3_9
Yab, L. Y., Wahid, N., & Hamid, R. A. (2023). Inversed control parameter in Whale Optimisation algorithm and Grey Wolf Optimiser for wrapper-based feature selection: A comparative study. International Journal on Informatics Visualisation, 7(2). https://doi.org/10.30630/joiv.7.2.1509
Yue, Z., Zhang, S., & Xiao, W. (2020). A novel hybrid algorithm based on Grey Wolf Optimiser and Fireworks algorithm. Sensors, 20(7), Article 7. https://doi.org/10.3390/s20072147
Zhao, J., Lv, S., Xiao, R., Ma, H., & Pan, J.-S. (2024). Hierarchical learning multi-objective firefly algorithm for high-dimensional feature selection. Applied Soft Computing, 165, 112042. https://doi.org/10.1016/j.asoc.2024.112042
Zhu, Z., Ong, Y. S., & Dash, M. (2007). Markov blanket-embedded genetic algorithm for gene selection. Pattern Recognition, 40(11), 3236–3248. https://doi.org/10.1016/J. PATCOG.2007.02.007
Published
Issue
Section
License
Copyright (c) 2024 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-06Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
