Fuzzy Unordered Rule Using Greedy Hill Climbing Feature Selection Method: An Application to Diabetes Classification
DOI:
https://doi.org/10.32890/jict2021.20.3.5Keywords:
Data mining, diabetes, feature selection, fuzzy logic, machine learningAbstract
Diabetes classification is one of the most crucial applications of healthcare diagnosis. Even though various studies have been conducted in this application, the classification problem remains challenging. Fuzzy logic techniques have recently obtained impressive achievements in different application domains especially medical diagnosis. Fuzzy logic technique is not able to deal with data of a large number of input variables in constructing a classification model. In this research, a fuzzy logic technique using greedy hill climbing feature selection methods was proposed for the classification of diabetes. A dataset of 520 patients from the Hospital of Sylhet in Bangladesh was used to train and evaluate the proposed classifier. Six classification criteria were considered to authenticate the results of the proposed classifier. Comparative analysis proved the effectiveness of the proposed classifier against Naive Bayes, support vector machine, K-nearest neighbour, decision tree, and multilayer perceptron neural network classifiers. Results of the proposed classifier demonstrated the potential of fuzzy logic in analyzing diabetes patterns in all classification criteria.
References
Aishwarya, S. S., & Anto, S. (2014). A medical expert system based on genetic algorithm and extreme learning machine for diabetes disease diagnosis. International Journal of Science, Engineering and Technology Research (IJSETR), 3(5), 1375–1380.
Al-behadili, H. N. K., Ku-Mahamud, K. R., & Sagban, R. (2020). Hybrid ant colony optimization and iterated local search for rules-based classification. Journal of Theoretical and Applied Information Technology, 98(04), 657–671.
Al-Behadili, H. N. K., Sagban, R., & Ku-Mahamud, K. R. (2020). Adaptive parameter control strategy for ant-miner classification algorithm. Indonesian Journal of Electrical Engineering and Informatics (IJEEI), 8(1), 149–162. https://doi.org/10.11591/ ijeei.v8i1.1423
Aydin, I., Karakose, M., & Akin, E. (2011). A multi-objective artificial immune algorithm for parameter optimization in support vector machine. Applied Soft Computing Journal, 11(1), 120–129. https://doi.org/10.1016/j.asoc.2009.11.003
Barakat, N., Bradley, A. P., & Barakat, M. N. H. (2010). Intelligible support vector machines for diagnosis of diabetes mellitus. IEEE Transactions on Information Technology in Biomedicine, 14(4), 1114–1120. https://doi.org/10.1109/TITB.2009.2039485
Beloufa, F., & Chikh. (2013). Design of fuzzy classifier for diabetes disease using modified artificial bee colony algorithm. Computer Methods and Programs in Biomedicine, 112(1), 92–103. https://doi.org/10.1016/j.cmpb.2013.07.009
Cai, F., Wang, H., Tang, X., Emmerich, M., & Verbeek, F. J. (2016). Fuzzy criteria in multi-objective feature selection for unsupervised learning. Procedia Computer Science, 102(August), 51–58. https://doi.org/10.1016/j. procs.2016.09.369 Journal of ICT, 20, No. 3 (July) 2021, pp: 391– Centers for Disease Control and Prevention, U. D. of H. and H. S. (2017). National diabetes statistics report, 2017. Estimates of diabetes and its burden in the United States background. Division of Diabetes Translation. https://doi.org/10.2196/ jmir.9515
Cohen, W. (1995). Fast effective rule induction. In Machine Learning Proceedings, 2435 (pp. 115–123).
David D. Luxton. (2016). An introduction to artificial intelligence in behavioral and mental health care. Academic Press.
Durgadevi, M., & Kalpana, R. (2018). Performance analysis of classification approaches for the prediction of type II diabetes. In 2017 9th International Conference on Advanced Computing, ICoAC 2017 (pp. 339–344). https://doi.org/10.1109/ ICoAC.2017.8441197
El-Alfy, E. S., & Al-Obeidat, F. (2014). A multicriterion fuzzy classification method with greedy attribute selection for anomaly-based intrusion detection. Procedia Computer Science, 34, 55–62. https://doi.org/10.1016/j.procs.2014.07.037
Faniqul, I., Rahatara, F., Sadikur, R., & Humayra, B. (2019). Likelihood prediction of diabetes at early stage using data mining techniques. In International Symposium, ISCMM 2019 (p. 154). Springer. https://doi.org/10.1007/978-981-13-8798-2_12
Ganji, M. F., & Abadeh, M. S. (2011). A fuzzy classification system based on ant colony optimization for diabetes disease diagnosis. Expert Systems with Applications, 38(12), 14650–14659. https://doi.org/10.1016/j.eswa.2011.05.018
Gupta, A., Mohammad, A., Syed, A., & N., M. (2016). A comparative study of classification algorithms using data mining: Crime and Accidents in Denver City the USA. International Journal of Advanced Computer Science and Applications, 7(7), 374–381. https://doi.org/10.14569/ijacsa.2016.070753
Hairuddin, N., Yusuf, L., & Othman, M. (2020). Gender classification on skeletal remains: Efficiency of metaheuristic algorithm method and optimized back propagation neural network. Journal of Information and Communication Technology, 19(2), 251–277. https://doi.org/10.32890/jict2020.19.2.5
Hedjazi, L., Kempowsky-Hamon, T., Despènes, L., Le Lann, M. V., Elgue, S., & Aguilar-Martin, J. (2010). Sensor placement and fault detection using an efficient fuzzy feature selection Journal of ICT, 20, No. 3 (July) 2021, pp: 391– approach. In Proceedings of the IEEE Conference on Decision and Control (pp. 6827–6832). https://doi.org/10.1109/ CDC.2010.5717254
Hssina, B., Merbouha, A., Ezzikouri, H., & Erritali, M. (2014). A comparative study of decision tree ID3 and C4.5. International Journal of Advanced Computer Science and Applications, 2, 13–19.
Hühn, J., & Hüllermeier, E. (2009). FURIA: An algorithm for unordered fuzzy rule induction. Data Mining and Knowledge Discovery, 19(3), 293–319. https://doi.org/10.1007/s10618-009-0131-8
Hülhn, C., & Hüllermeier, E. (2010). An analysis of the FURIA algorithm for fuzzy rule induction. Studies in Computational Intelligence, 262, 321–344. https://doi.org/10.1007/978-3-642-05177-7_16
Irfan, M., Uriawan, W., Kurahman, O. T., Ramdhani, M. A., & Dahlia, I. A. (2018). Comparison of Naive Bayes and K-Nearest Neighbor methods to predict divorce issues. In IOP Conference Series: Materials Science and Engineering (Vol. 434, No. 1, p. 012047). https://doi.org/10.1088/1757-899X/434/1/012047
Jaganathan, P., Thangavel, K., Pethalakshmi, A., & Karnan, M. (2007). Classification rule discovery with ant colony optimization and improved quick reduct algorithm. IAENG International Journal of Computer Science, February, 286–291. http://www.scopus.com/inward/record.url?eid=2-s2.0-84888273942&partnerID=tZOtx3y1
Jain, V., & Raheja, S. (2015). Improving the prediction rate of diabetes using fuzzy expert system. International Journal of Information Technology and Computer Science, 7(10), 84–91. https://doi.org/10.5815/ijitcs.2015.10.10
Jalali, L., Nasiri, M., & Minaei, B. (2009). A hybrid feature selection method based on fuzzy feature selection and consistency measures. In Proceedings - 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems, ICIS 2009 (Vol. 1, pp. 718–722). https://doi.org/10.1109/ ICICISYS.2009.5358395
Kahramanli, H., & Allahverdi, N. (2008). Design of a hybrid system for the diabetes and heart diseases. Expert Systems with Applications, 35(1–2), 82–89. https://doi.org/10.1016/j. eswa.2007.06.004 Journal of ICT, 20, No. 3 (July) 2021, pp: 391–
Karim, O., Yasser, K., & Thanaa, R. (2016). Early predictive system for diabetes mellitus disease. In Industrial Conference on Data Mining (pp. 420–427). https://doi.org/10.1007/978-3-319-41561-1
Kaur, G., & Chhabra, A. (2014). Improved J48 classification algorithm for the prediction of diabetes. International Journal of Computer Applications, 98(22), 13–17. https://doi.org/10.5120/17314-7433
Kaur, H., & Kumari, V. (2019). Predictive modelling and analytics for diabetes using a machine learning approach. Applied Computing and Informatics, February 2019. https://doi.org/10.1016/j. aci.2018.12.004
Liao, Y., & Vemuri, V. R. (2002). Use of k-nearest neighbor classifier for intrusion detection. Computers and Security, 21(5), 439–448. https://doi.org/10.1016/S0167-4048(02)00514-X
Mei, J., Zhao, S., Jin, F., Zhang, L., Liu, H., Li, X., Xie, G., Li, X., & Xu, M. (2017). Deep diabetologist: Learning to prescribe hypoglycemic medications with recurrent neural networks. Studies in Health Technology and Informatics, 245, 1277. https://doi.org/10.3233/978-1-61499-830-3-1277
Mishra, S., Tripathy, H. K., Mallick, P. K., Akash, K. B., & Paolo, B. (2020). EAGA-MLP – An enhanced and adaptive hybrid classification model for diabetes diagnosis. Sensors, 20(14), 1–31. https://doi.org/10.3390/s20144036
Mohamed, W. N. H. W., Salleh, M. N. M., & Omar, A. H. (2012). A comparative study of reduced error pruning method in decision tree algorithms. In Proceedings - 2012 IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2012 (pp. 392–397). https://doi.org/10.1109/ ICCSCE.2012.6487177
Morgan, N. (2018). Diabetic Neuropathy. In University of North Dakota. https://doi.org/10.1177/004947550203200403
Ngan, P. S., Wong, M. L., Lam, W., Leung, K. S., & Cheng, J. C. Y. (1999). Medical data mining using evolutionary computation. Artificial Intelligence in Medicine, 16(1), 73–96. https://doi.org/10.1016/S0933-3657(98)00065-7
Nosrati Nahook, H., & Eftekhari, M. (2014). A new method for feature selection based on fuzzy similarity measures using multi objective genetic algorithm. Journal of Fuzzy Set Valued Analysis, 2014, 1–12. https://doi.org/10.5899/2014/jfsva-00162 Journal of ICT, 20, No. 3 (July) 2021, pp: 391–
Perveen, S., Shahbaz, M., Guergachi, A., & Keshavjee, K. (2016). Performance analysis of data mining classification techniques to predict diabetes. Procedia Computer Science, 82, 115–121. https://doi.org/10.1016/j.procs.2016.04.016
Rahman, A., Muhammad, S., Muhammad, I., & Byeong, K. (2014). Prediction of diabetes mellitus based on boosting ensemble modeling. In International Conference on Ubiquitous Computing and Ambient Intelligence (pp. 1–8). https://doi.org/10.1007/978-3-319-13102-3
Saxena, K., Khan, Z., & Singh, S. (2014). Diagnosis of diabetes mellitus using K Nearest Neighbor algorithm. International Journal of Computer Science Trends and Technology (IJCST), 2(4), 36–43.
Sharif, N., Ahmad, N., Ahmad, N., Desa Mat, W., Helmy, K., Ang, W., & Abidin, I. (2019). A fuzzy rule-based expert system for asthma severity identification in emergency department. Journal of Information and Communication Technology, 18(4), 415–438. https://doi.org/10.32890/jict2019.18.4.2
Sisodia, D., & Sisodia, D. S. (2018). Prediction of diabetes using classification algorithms. Procedia Computer Science, 132(Iccids), 1578–1585. https://doi.org/10.1016/j.procs.2018.05.122
Smith, J. W., Everhart, J. E., Dickson, W. C., Knowler, W. C., & Johannes, R. S. (1988). Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In Proceedings - Annual Symposium on Computer Applications in Medical Care (pp. 261–265).
Temurtas, H., Yumusak, N., & Temurtas, F. (2009). A comparative study on diabetes disease diagnosis using neural networks. Expert Systems with Applications, 36(4), 8610–8615. https://doi.org/10.1016/j.eswa.2008.10.032
Tkáč, M., & Verner, R. (2015). Artificial neural networks in business: Two decades of research. In Applied Soft Computing, 38, 788–804. Elsevier B.V. https://doi.org/10.1016/j.asoc.2015.09.040
Tnv, M., & Gundabathina, J. (2016). Fuzzy classification rules generation with ant colony optimization for diabetes diagnosis. International Journal of Emerging Trends & Technology in Computer Science (IJETTCS), 5(5), 39–44.
Venkatesh, B., & Anuradha, J. (2019). A review of feature selection and its methods. Cybernetics and Information Technologies, 19(1), 3–26. https://doi.org/10.2478/CAIT-2019-0001 Journal of ICT, 20, No. 3 (July) 2021, pp: 391–
Vieira, S., Sousa, J., & Kaymak, U. (2012). Fuzzy criteria for feature selection. Fuzzy Sets and Systems, 189(1), 1–18. https://doi.org/10.1016/j.fss.2011.09.009
Vitabile, S., Marks, M., Stojanovic, D., Pllana, S., Molina, J. M., Krzyszton, M.,... & Ilic, A. S. (2019). Medical data processing and analysis for remote health and activities monitoring. In High-Performance Modelling and Simulation for Big Data Applications (pp. 186–220). https://doi.org/10.1007/978-3-030-16272-6
Published
Issue
Section
License
Copyright (c) 2022 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-06Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
- Scopus 14 View →
- OpenAlex 13 View →
- OpenCitations 8 View →
- Crossref 8 View →
- Semantic Scholar 7 View →
- Google Scholar no free count Search →
- Dimensions no free count Search →
2002 - 2020
