Searching Malay Text Using Stemming Algorithm

Authors

  • Rizauddin Saian Department of Mathematical Sciences and Statistics, Universiti Teknologi MARA Perlis, 02600 Arau, Perlis., Malaysia
  • K. R. Ku-Mahamud Faculty of Information Technology, Universiti Utara Malaysia, 06010 Sintok, Kedah., Malaysia

DOI:

https://doi.org/10.32890/jict2004.3.2.7

Keywords:

stemming, information retrieval, retrieval effectiveness

Abstract

Stemming is an important process to improve the performance of a search engine by reducing the variant word forms to common forms. This paper evaluates the retrieval effectiveness of stemming algorithm in searching and retrieving relevant Malay web pages based on user natural query words. The retrieved web pages are weighted and ranked using inverse document frequency function. The retrieval effectiveness is measured using standard recall and precision. Experiments performed show that searching with stemming improves retrieval effectiveness when compared to searching without stemming algorithm.

 

References

Ahmad, F., Yusoff, M. & Sembok, T.M.T. (1996). Experiments with a Stemming Algorithm for Malay Words. Journal of the American Society for Information Science, 47(12), 909-918.

Asim O. (1993). Pengakar Perkataan Melayu Untuk Sistem Capaian Documen. MSc Thesis. National Universiti of Malaysia.

Cercone, N. (1978). Morphological Analysis and Lexicon Design for Natural Language Processing. Computers and Humanities, 11, 199-209.

Ekmekcioglu, F. Cuna, L, Michael F. & Willett, P. (1996). Stemming and N-gram matching for term conflation in Turkish texts. Information Research, 1(1). Retrieved July 20, 2004 from http://informationr.net/ir/2-2/paper13.html.

Frakes, W.B. (1992). Stemming Algorithms. In W. B. Frakes and R. Baeza (Ed), Information Retrieval, Data Structures and Algorithms. Upper Saddle River, NJ, USA: Prentice Hall.

Frakes, W.B. (1984). Term Conflation for Information Retrieval. In van Rijsbergen, C. J. (Ed.), Research and Development in Information Retrieval. CUP: Cambridge. Journal of ICT, 3 (2), pp: 107-

Freud, G.E. & Willett, P. (1982). Online Identification of Word Variants and Arbitrary Truncation Searching Using a String Similarity Measure. Information Technology Research and Development, 1, 177-187.

Hafer, MA. & Weiss, S.F. (1974). Word Segmentation by Letter Successor Varieties. Information Storage and Retrieval, 10, 371-385.

Harman, D. (1991). How Effective is Suffixing?. Journal of the American Society for Information Science, 42(1), 7-15.

Idris, N. & Syed Mustapha, S.M.F.D. (2001). Stemming for Term Conflation in Malay Texts. International Conference of Artificial Intelligence. April 23, 2001. (pp. 1512—1517). Las Vegas.

Kantrowitz, M., Mohit, B., & Mittal, V. (2000). Stemming and Its Effects of TFIDF Ranking. Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. July 24-28, 2000. (pp. 357-359). Athens, Greece.

Lennon, M., Peirce, D.S., Tarry, B.D. & Willet, P. (1981). An evaluation for some conflation algorithms for information retrieval. Journal of Information Science, 3, 177-183.

Lovins, J.B. (1968). Development of a Stemming Algorithm. Mechanical Translation and Computational Linguistics, 11, 22-31. ct.uum.edu.my/ <= Niedermair, G.T., Thurmair, G. & Buttel, I. (1984). MARS A Retrieval Tool on the Basis of Morphological Analysis. In van Rijsbergen, C. J. (Ed.), Research "and Development in Information Retrieval, Proceedings of the Third Joint BCS/ ACM OQ. Symposium on Research and Development in Information Retrieval, Cambridge. July —_— 2-6, 1984. (pp. 369-381). CUP: Cambridge, England. /| -— Paice, CD. (1990). Another Stemmer. ACM SIGIR Forum, 24(3), 56-61.

Pirkola, A. (2001). Morphological Typology of Languages for IR. Journal of Documentation, 57, 330-348.

Popovic, M. & Willet, P. (1992). The Effectiveness of Stemming for Natural-Language Access to Slovene Textual Data. Journal of the American Society for Information Science, 43(5), 384-390. http://ict.uum.edu.my/ Journal of ICT, 3 (2), pp: 107-

Porter, M.-F. (1980). An Algorithm for Suffix Stripping. Program, 14(3), 130-137.

Raben, J. & Lieberman, D.V. (1976). Text comparison: principles and a program. In Jones, A & Churchouse, R. F. (Eds.), The computer in literacy and Anguistic studies (pp. 297-308). Cardiff: University of Wales Press.

Savoy, J. (1993). Stemming of French Words Based on Grammatical Categories. Journal of the American Society for Information Science, 44, 1-9.

Stephen, G.A. (1994). String Searching Algorithm. In Lecture Notes Series on Computing. Singapore: World Scientific Publishing Co. Pte. Ltd.

Ulmschneider, J.E. & Doszkocs, T. (1983). A Practical Stemming Algorithm for Online Search Assistance. Online Review, 7, 301-318.

Van Rijsbergen, CJ. (1979). Information Retrieval (Second Edition). London: Butterworths.

Walker, S. & Jones, R.M. (1987). Improving Subject Retrieval in Online Catalogues. 1. Stemming, Automatic Spelling Correction and Cross-Reference Tables, British Library Research Paper, London.

Wen, J.R., Nie, J.Y. & Zhang H,J. (2001). Clustering User Queries of a Search Engines. ACM, Proceedings Of The Tenth International Conference On World Wide Web. May 1-5, 2001. (pp. 162-168). Hong Kong.

Zainab, A.B. & Nurazzah, A.R. (2004). Evaluating the Effectiveness of Conflation Methods in Retreiving Malay Translated Al-Quran Texts and Images. Conference on S. dentific and Social Research, UiTM. May 19-21, 2004. Kuching, Sawarak, Malaysia.

Zeti, Z.M.Z. (2004). Penipuan Kad Kredit di Malaysia. LLM Thesis, National University of Malaysia.

Downloads

Published

30-11-2004

Issue

Vol. 3 No. 2 (2004): Journal of Information and Communication Technology (JICT) Vol. 3, No.2 Dec 2004

Section

Articles

How to Cite

Saian, R., & Ku-Mahamud, K. R. (2004). Searching Malay Text Using Stemming Algorithm. Journal of Information and Communication Technology, 3(2), 107-117. https://doi.org/10.32890/jict2004.3.2.7

Research impact

Harvested 2026-09-06
2 citations, from OpenAlex — the highest of the sources checked

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2004.3.2.7 OpenAlex W1526696664

Most read articles by the same author(s)