Automatic Negation Detection for Semantic Analysis in Arabic Hotel Reviews Through Lexical and Structural Features: A Supervised Classification
DOI:
https://doi.org/10.32890/jict2024.23.4.5Keywords:
Arabic hotel reviews, lexical features, negation detection, semantic analysis, structural features, supervised classificationAbstract
One significant challenge in sentiment analysis is the presence of negation, which reverses the meanings of sentences, transforming
positive statements into negative ones and impacting the sentiment conveyed in the text. This issue is particularly pronounced in Arabic, a language known for its complex morphology. Detecting negation is crucial for enhancing sentiment analysis performance and various natural language processing applications. This paper presents an approach for automatically detecting negation in user-generated Arabic hotel reviews through lexical and structural features. It comprises several stages: data collection, text pre-processing, feature extraction, supervised learning classification, and evaluation. The study employed multiple supervised classification techniques, including naïve Bayes, random forest, logistic regression, support vector machines, and deep learning, to analyse lexical and structural features extracted from the dataset. The results of the experiments yielded promising outcomes, demonstrating the feasibility of the approach for practical applications. The classifiers exhibited highly comparable performance in identifying negation, with only marginal deviations in their performance metrics. Notably, the deep learning classifier consistently emerged as the top performer, achieving an exceptionally high overall accuracy rate of 99.24 percent, surpassing established benchmarks in Arabic text processing and underscoring its potential for practical applications. These findings hold significant implications for advancing Arabic text processing, particularly in sentiment analysis and related NLP tasks. The high accuracy of 99.24 percent achieved by the deep learning classifier highlights its robustness in accurately detecting negation, a critical challenge in sentiment analysis. This classifier performance demonstrates the potential to be integrated into real-world applications, such as automated review systems and opinion mining tools, where accurate sentiment interpretation is essential.
References
Abuhammad, S., & Ahmed, M. A. (2023). Negation detection techniques in sentiment analysis: A survey. International Journal of Applied Science and Engineering, 20(2), 1–7. https://doi.org/10.6703/ijase.202306_20(2).003
Aldayel, H. K., & Azmi, A. M. (2016). Arabic tweets sentiment analysis: A hybrid scheme. Journal of Information Science, 42(6), 782–797. https://doi.org/10.1177/0165551515610513
Alharbi, O. (2020). Negation handling in machine learning-based sentiment classification for colloquial Arabic. International Journal of Operations Research and Information Systems, 11(4), 33–45. https://doi.org/10.4018/ijoris.2020100102 Journal of ICT, 23, No. 4 (October) 2024, pp: 709-
Alotaibi, S. S. (2015). Sentiment analysis in the Arabic language using machine learning [Master’s thesis, Colorado State University]. Mountain Scholar. https://mountainscholar.org/ handle/10217/167091
Altair. (n.d.). In RapidMiner: Data analytics and AI platform. http://rapidminer.com/
Burbach, L., Halbach, P., Ziefle, M., & Calero Valdez, A. (2020). Opinion formation on the internet: The influence of personality, network structure, and content on sharing messages online. Frontiers in Artificial Intelligence, 3, 45. https://doi.org/10.3389/frai.2020.00045
Collins Dictionary (2023). Negation definition & meaning. In Collins Dictionary. https://www.collinsdictionary.com/dictionary/ english/negation
Councill, I. G., McDonald, R., & Velikovich, L. (2010). What’s great and what’s not: Learning to classify the scope of negation for improved sentiment analysis. In Proceedings of the Workshop on Negation and Speculation in Natural Language Processing (NeSp-NLP) (pp. 51–59). Association for Computational Linguistics. https://aclanthology.org/2010.nespnlp-1.7
Deng, L., & Yu, D. (2014). Deep learning. Springer.
Dictionary.com. (n.d.). Negation. In Lexico. https://www.lexico.com/ definition/negation
Duda, R. O., Hart, P. E., & Stork, D. G. (2012). Pattern classification. John Wiley & Sons.
El-Dine, A., & El-Zahraa, F. (2013). Sentiment analyser for Arabic comments system. International Journal of Advanced Computer Science and Applications, 4(3). https://doi.org/10.14569/ ijacsa.2013.040317
Eremyan, R. (2023). Four pitfalls of sentiment analysis accuracy. Toptal Engineering Blog. https://www.toptal.com/deep-learning/4-sentiment-analysis-accuracy-traps
Farooq, U. (2017). Negation handling in sentiment analysis at sentence level. Journal of Computers, 12(5), 470–478. https://doi.org/10.17706/jcp.12.5.470-478
Farra, N., Challita, E., Assi, A., & Hajj, H. (2010). Sentence-level and document-level sentiment mining for Arabic texts. In Data Mining Workshops (ICDMW) – IEEE International Conference Proceedings (pp. 1114–1119).
Funkner, A., Balabaeva, K., & Kovalchuk, S. (2020). Negation detection for clinical text mining in Russian. Studies in Health Technology and Informatics, 270, 43–47. https://doi.org/10.3233/SHTI200889 Journal of ICT, 23, No. 4 (October) 2024, pp: 709-
Genadi, R. A., & Khodra, M. L. (2022). Opinion Triplet Extraction for Aspect-Based Sentiment Analysis Using Co-Extraction Approach. Journal of Information and Communication Technology, 21(2), 255–277. https://doi.org/10.32890/ jict2022.21.2.5
Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT Press. http://books.google.ie/books?id=omivDQAAQBA J&printsec=frontcover&dq=Deep+Learning&hl=&cd=1&sour ce=gbs_api
Han, J., Kamber, M., & Pei, J. (2011). Data mining: Concepts and techniques (3rd ed.). Elsevier.
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression (3rd ed.). John Wiley & Sons. https://books. google.com/books?id=bRoxQBIZRd4C
Hussein, D. M. E. D. M. (2018). A survey on sentiment analysis challenges. Journal of King Saud University - Engineering Sciences, 30(4), 330–338. https://doi.org/10.1016/j. jksues.2016.04.002
Javatpoint. (n.d.). Machine learning random forest algorithm. https://www.javatpoint.com/machine-learning-random-forest-algorithm
Larkey, L., Ballesteros, L., & Connell, M. (2002). Improving stemming for Arabic information retrieval: Light stemming and co-occurrence analysis. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 275-282). ACM.
Lee, S. (2018). Application of artificial neural networks in geoinformatics. MDPI. http://books.google.ie/books?id=2MF UDwAAQBAJ&printsec=frontcover&dq=Artificial+Neural+ Networks+Handbook+of+Research+on+Geoinformatics&hl= &cd=2&source=gbs_api
Mahany, A., Fouad, M. M., Aloraini, A., Khaled, H., Nawaz, R., Aljohani, N. R., & Ghoniemy, S. (2021). Supervised learning for negation scope detection in Arabic texts. In IEEE 10th International Conference on Intelligent Computing and Information Systems (ICICIS) – Conference Proceedings (pp. 177–182). Cairo, Egypt.
Martín-Valdivia, M., Montejo-Ráez, A., Ureña-López, L. A., & Saleh, M. (2012). Learning to classify neutral examples from positive and negative opinions. Journal of Universal Computer Science, 18(16), 2319–2333. Journal of ICT, 23, No. 4 (October) 2024, pp: 709-
Mohammad, S. (2016). A practical guide to sentiment annotation: Challenges and solutions. In Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (pp. 174–179). San Diego, California.
Mukherjee, P., Badr, Y., Doppalapudi, S., Srinivasan, S. M., Sangwan, R. S., & Sharma, R. (2021). Effect of negation in sentences on sentiment analysis and polarity detection. Procedia Computer Science, 185, 370–379. https://doi.org/10.1016/j. procs.2021.05.038
Patodkar, V. N., & Sheikh I. R. (2016). Twitter as a corpus for sentiment analysis and opinion mining. International Journal of Advanced Research in Computer and Communication Engineering, 5(12), 320–322. https://doi.org/10.17148/ijarcce.2016.51274
Raeder, J. (2016). Automatic sarcasm detection in Twitter messages [Master’s thesis, Norwegian University of Science and Technology, Department of Computer and Information Science].
Reitan, J., Faret, J., Gambäck, B., & Bungum, L. (2015). Negation scope detection for Twitter sentiment analysis. In Proceedings of the 6th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (pp. 99–108).
Saad, M. (2010). The impact of text pre-processing and term weighting on Arabic text classification [Master’s thesis, Department of Computer Engineering, The Islamic University-Gaza].
Silva, C., & Ribeiro, B. (2003). The importance of stop word removal on recall values in text categorisation. In Proceedings of the International Joint Conference on Neural Networks (Vol. 3, pp. 1661-1666). Portland, OR, USA.
Witten, I. H., & Frank, E. (2009). Data mining: Practical machine learning tools and techniques (2nd ed.). Morgan Kaufmann. http://books.google.ie/books?id=ic9MPgAACAAJ&dq=Data+ Mining:+Practical+Machine+Learning+Tools+and+Technique s&hl=&cd=9&source=gbs_api
Wikipedia (2023a). Arabic. Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/wiki/Arabic
Wikipedia (2023b). Lexical analysis. Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/wiki/Lexical_ analysis#Tokenization
World Internet Users’ Statistics and 2023 World Population Stats. (n.d.). Internet World Stats. https://www.internetworldstats. com/stats.htm
Published
Issue
Section
License
Copyright (c) 2024 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-06Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
