Multi-label Classification Using Vector Generalized Additive Model via Cross-Validation
DOI:
https://doi.org/10.32890/jict2023.22.4.5Keywords:
classification, cross-validation, generalized model, multi-label, semi-parametricAbstract
Multi-label classification is a unique challenge in machine learning designed for two targets with each containing one or multiple classes. This problem can be resolved using several methods, including the classification of the targets individually or simultaneously.
However, most models cannot classify the target simultaneously, and this is not expected to happen in the modeling rule. This study
was conducted to propose a novel solution in the form of a Vector Generalized Additive Model Using Cross-Validation (VGAMCV) to
address these problems. The proposed method leverages the Vector Generalized Additive Model (VGAM), which is a semi-parametric
model combining both parametric and non-parametric components as the underlying base model. Cross-validation was also applied
to tune the parameters to optimize the performance of the method. Moreover, the methodology of VGAMCV was compared with a
tree-based model, Random Forest, commonly used in multi-label classification to evaluate its effectiveness based on fourteen metric
scores. The results showed positive outcomes as indicated by 0.703 average accuracy and 0.601 Area Under Curve (AUC) recorded, but
these improvements were not statistically significant. Meanwhile, the method offered a viable alternative for multi-label classification
tasks, and its introduction served as a contribution to the expanding repertoire of methods available for this purpose.
References
Alic, B., Gurbeta, L., & Badnjevic, A. (2017). Machine learning techniques for classification of diabetes and cardiovascular diseases. 2017 6th Mediterranean Conference on Embedded Computing (MECO), 1–4. https://doi.org/10.1109/ MECO.2017.7977152
Charte, F., & Charte, D. (2015). Working with multi-label datasets in R: The MLDR Package. The R Journal, 7(2), 149. https://doi.org/10.32614/RJ-2015-027 Journal of ICT, 22, No. 4 (Oct) 2023, pp: 657-
Chowdhury, S., & Schoen, M. P. (2020, October 2). Research Paper Classification using Supervised Machine Learning Techniques. 2020 Intermountain Engineering, Technology and Computing, IETC 2020. https://doi.org/10.1109/IETC47856.2020.9249211
Harezlak, J., Ruppert, D., & Wand, M. P. (2018). Semiparametric Regression with R. Springer New York. https://doi.org/10.1007/978-1-4939-8853-2
Kommu, G. R., Trupthi, M., & Pabboju, S. (2014). A novel approach for multi-label classification using probabilistic classifiers. 2014 International Conference on Advances in Engineering & Technology Research (ICAETR - 2014), 1–8. https://doi.org/10.1109/ICAETR.2014.7012929
Mohammed, H. H., Dogdu, E., Gorur, A. K., & Choupani, R. (2020). Multi-label classification of text documents using deep learning. Proceedings - 2020 IEEE International Conference on Big Data, Big Data 2020, 4681–4689. https://doi.org/10.1109/ BigData50022.2020.9378266
Muhamedyev, R., Yakunin, K., Iskakov, S., Sainova, S., Abdilmanova, A., & Kuchin, Y. (2015). Comparative analysis of classification algorithms. 2015 9th International Conference on Application of Information and Communication Technologies (AICT), 96–101. https://doi.org/10.1109/ICAICT.2015.7338525
Novita Sari, N., Zain, I., Fithriasari, K., & Muhaimin, A. (2021, October 19). BR+ for Addressing Imbalanced Multi-label Data Classification Combined with Resampling Technique. https://doi.org/10.4108/eai.19-12-2020.2309179
Pan, Di., Zheng, X., Liu, W., Li, M., Ma, M., Zhou, Y., Yang, L., & Wang, P. (2020). Multi-label classification for clinical text with feature-level attention. Proceedings - 2020 IEEE 6th Intl Conference on Big Data Security on Cloud, BigDataSecurity 2020, 2020 IEEE Intl Conference on High Performance and Smart Computing, HPSC 2020 and 2020 IEEE Intl Conference on Intelligent Data and Security, IDS 2020, 186–191. https://doi.org/10.1109/BigDataSecurity-HPSC-IDS49724.2020.00042
Rahmawati, D., & Khodra, M. L. (2015). Automatic multi-label classification for Indonesian news articles. 2015 2nd International Conference on Advanced Informatics: Concepts, Theory, and Applications (ICAICTA), 1–6. https://doi.org/10.1109/ICAICTA.2015.7335382
Read, J., Puurula, A., & Bifet, A. (2014). Multi-label classification with meta-labels. Proceedings - IEEE International Conference on Data Mining, ICDM, 2015-January(January), 941–946. https://doi.org/10.1109/ICDM.2014.38 Journal of ICT, 22, No. 4 (Oct) 2023, pp: 657-
Sharma, S., & Mehrotra, D. (2018). Comparative analysis of multi-label classification algorithms. 2018 First International Conference on Secure Cyber Computing and Communication (ICSCCC), 35–38. https://doi.org/10.1109/ICSCCC.2018.8703285
Tabia, K. (2019). Towards explainable multi-label classification. Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI, 2019-November, 1088–1095. https://doi.org/10.1109/ICTAI.2019.00152
Taha, A. Y., Tiun, S., Abd Rahman, A. H., & Sabah, A. (2021). Multi-label over-sampling and under-sampling with class alignment for imbalanced multi-label text classification. Journal of Information and Communication Technology, 20(3), 423–456. https://doi.org/10.32890/jict2021.20.3.6
Venkatesan, R., & Er, M. J. (2014). Multi-label classification method based on extreme learning machines. 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV), 619–624. https://doi.org/10.1109/ ICARCV.2014.7064375
Wang, X., Liu, H., Yang, Z., Chu, J., Yao, L., Zhao, Z., & Zuo, B. (2017). Research and implementation of a multi-label learning algorithm for Chinese text classification. Proceedings - 2017 3rd International Conference on Big Data Computing and Communications, BigCom 2017, 68–76. https://doi.org/10.1109/BIGCOM.2017.34
Yee, T. W., Wild, C. J., & Yeet, T. W. (1996). Vector generalized additive models. Journal of the Royal Statistical Society: Series B (Methodological), 58(3), 481-493. https://www.jstor. org/stable/2345888
Published
Issue
Section
License
Copyright (c) 2023 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-22Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
