A Syntactic-Based Sentence Validation Technique for Malay Text Summarizer
DOI:
https://doi.org/10.32890/jict2021.20.3.3Keywords:
Malay text summarization, Sentence compression, Syntactic rules, POS, ParserAbstract
In the Automatic Text Summarization domain, a Sentence Compression (SC) technique is applied to the summary sentence to remove unnecessary words or phrases. The purpose of SC is to preserve the important information in the sentence and to remove the unnecessary ones without sacrificing the sentence's grammar. The existing development of Malay Natural Language Processing (NLP) tools is still under study with limited open access. The issue is the lack of a benchmark dataset in the Malay language to evaluate the quality of the summaries and to validate the compressed sentence produced by the summarizer model. Hence, our paper outlines a Syntactic-based Sentence Validation technique for Malay sentences by referring to the Malay Grammar Pattern. In this work, we propose a new derivation set of Syntactic Rules based on the Malay main Word Class to validate a Malay sentence that undergoes the SC procedure. We experimented using the Malay dataset of 100 new articles covering the Natural Disaster and Events domain to find the optimal compression rate and its effect on the summary content. An automatic evaluation using ROUGE (Recall-Oriented Understudy for Gisting Evaluation) produced a result with an average F-measure of 0.5826 and an average Recall value of 0.5925 with an optimum compression rate of 0.5 Confidence Conf value. Furthermore, a manual summary evaluation by a group of Malay experts on the grammaticality of the compressed summary sentence produced a good result of 4.11 and a readability score of 4.12 out of 5. This depicts the reliability of the proposed technique to validate the Malay sentence with promising summary content and readability results.
References
Ab Aziz, M. J., Ahmad, F., Ghani, A. A. A., & Mahmod, R. (2006). Pola grammar technique for grammatical relation extraction in Malay language. Malaysian Journal of Computer Science, 19(1), 59.
Alfred, R., Mujat, A., & Obit, J. H. (2013). A ruled-based part of speech (RPOS) tagger for Malay text articles. In Asian Conference on Intelligent Information and Database Systems (pp. 50–59). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36543-0_6
Alias, S. (2018). A pattern-growth sentence compression technique for Malay text summarizer. Doctoral dissertation, Universiti Sains Malaysia.
Ariffin, S. N. A. N., & Tiun, S. (2018). Part-of-speech tagger for Malay social media texts. GEMA Online® Journal of Language Studies, 18(4). http://dx.doi.org/10.17576/gema-2018-1804-09
Conroy, J. M., Schlesinger, J. D., O’leary, D. P., & Goldstein, J. (2006, November). Back to basics: CLASSY 2006. In Proceedings of DUC (Vol. 6, No. 460, p. 460).
Hamza, M. A., Ab Aziz, M. J., & Omar, N. (2019). Identification of sentence context based on thematic role rules for Malay short essay assessment. International Journal of Software Engineering and Computer Systems, 5(2), 66–77.
Jing, H. (2000, April). Sentence reduction for automatic text summarization. In Proceedings of the Sixth Conference on Journal of ICT, 20, No. 3 (July) 2021, pp: 329– Applied Natural Language Processing (pp. 310–315). https://doi.org/10.3115/974147.974190
Jusoh, S., Masoud, A. M., & Alfawareh, H. M. (2011). Automated text summarization: Sentence refinement approach. In P. J. Snasel V., El-Qawasmeh E. (Ed.), Digital Information Processing and Communications. Communications in Computer and Information Science, 189, 207-218. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22410-2_18
Knowles, G., & Don, Z. M. (2003). Tagging a corpus of Malay texts, and coping with ‘syntactic drift’. In Proceedings of the Corpus Linguistics 2003 Conference (pp. 422–428).
Lin, C.-Y. (2004, July). Rouge: A package for automatic evaluation of summaries. In Text Summarization Branches Out: Proceedings of the ACL-04 Workshop (pp. 74–81).
Mohamed, H., Omar, N., & Ab Aziz, M. J. (2011). Statistical Malay part-of-speech (POS) tagger using Hidden Markov approach. In 2011 International Conference on Semantic Technology and Information Retrieval (pp. 231–236). https://doi.org/10.1109/ STAIR.2011.5995794
Mohd Don, Z. (2010). Processing natural Malay texts: A data-driven approach. Trames, 14(1), 90–103. https://doi.org/10.3176/ tr.2010.1.06 Nik Safiah Karim, Farid M. Onn, Hashim Haji Musa & Mahmood, A. H. (2008). Tatabahasa Dewan Edisi Ketiga: Dewan Bahasa dan Pustaka.
Omar, A. H. (1998). Morfologi-sintaksis bahasa Melayu (Malaya) dan bahasa Indonesia: Satu perbandingan pola. Kuala Lumpur: Dewan Bahasa dan Pustaka.
Tran, N.-T., Ung, V.-G., Luong, A.-V., Nghiem, M.-Q., & Nguyen, N. L.-T. (2015). Improving Vietnamese sentence compression by segmenting meaning chunks. In Knowledge and Systems Engineering (KSE), 2015 Seventh International Conference (pp. 320–323). https://doi.org/10.1109/KSE.2015.74
Wang, L., Raghavan, H., Castelli, V., Florian, R., & Cardie, C. (2013). A sentence compression based framework to query-focused multi-document summarization. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, Sofia, Bulgaria.
Xian, B. C. M., Lubani, M., Ping, L. K., Bouzekri, K., Mahmud, R., & Lukose, D. (2016). Benchmarking Mi-POS: Malay part-of-Journal of ICT, 20, No. 3 (July) 2021, pp: 329– speech tagger. International Journal of Knowledge Engineering, 2(3), 115–121. https://doi.org/10.18178/ijke.2016.2.3.064
Zajic, D., Dorr, B. J., Lin, J., & Schwartz, R. (2007). Multi-candidate reduction: Sentence compression as a tool for document summarization tasks. Information Processing & Management, 43(6), 1549–1570. https://doi.org/10.1016/j.ipm.2007.01.016
Zamin, N., & Ghani, A. (2010). A hybrid approach for Malay text summarizer. In Proceedings of the International Multi-Conference on Engineering and Technological Innovation.
Zamin, N., Oxley, A., Abu Bakar, Z., & Farhan, S. A. (2012). A statistical dictionary-based word alignment algorithm: An unsupervised approach. In 2012 International Conference on Computer and Information Science, ICCIS 2012 - A Conference of World Engineering, Science and Technology Congress, ESTCON 2012 - Conference Proceedings, 1, (pp. 396–402). https://doi.org/10.1109/ICCISci.2012.6297278 Journal of ICT, 20, No. 3 (July) 2021, pp: 329–
Published
Issue
Section
License
Copyright (c) 2022 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-06Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
