A Meta-heuristic Algorithm for the Minimal High-Quality Feature Extraction of Online Reviews
DOI:
https://doi.org/10.32890/jict2022.21.4.5Keywords:
Feature extraction, feature selection, online reviews, meta-heuristics, sentiment analysisAbstract
Feature extraction and selection are critical in sentiment analysis (SA) to extract and select only the appropriate features by removing those deemed redundant. As such, the successful implementation of this process leads to better classification accuracy. Inevitably, selecting high-quality minimal features can be challenging given the inherent complication in dealing with over-fitting issues. Most of the current studies used a heuristic method to perform the classification process that will result in selecting and examining only a single feature subset, while ignoring the other subsets that might give better results. This study explored the effect of using the meta-heuristic method together with the ensemble classification method in the sentiment classification of online reviews. Adding to that point, the extraction and selection of relevant features used feature ranking, hyper-parameter optimization, crossover, and mutation, while the classification process utilized the ensemble classifier. The proposed method was tested on the polarity movie review dataset v2.0 and product review dataset (books, electronics, kitchen, and music). The test results indicated that the proposed method significantly improved the classification results by 94%, which far exceeded the existing method. Therefore, the proposed feature extraction and selection method can help in improving the performance of SA in online reviews and, at the same time, reduce the
number of extracted features.
References
Agarwal, B., & Mittal, N. (2016). Machine learning approach for sentiment analysis. In Prominent feature extraction for sentiment analysis (pp. 21–45). Springer, Cham.. https://doi.org/10.1007/978-3-319-25343-5_3
Al-Harbi, O. (2019). A comparative study of feature selection methods for dialectal Arabic sentiment classification using support vector machine. International Journal of Computer Science and Network Security, 19(1), 167–176.
Asghar, M. Z., Khan, A., Ahmad, S., & Kundi, F. M. (2014). A review of feature extraction in sentiment analysis. Journal of Basic and Applied Research International, 4(3), 181–186. https://doi.org/10.3233/IDA-173763
Baccianella, S., Esuli, A., & Sebastiani, F. (2014, May). SentiWordNet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining. In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC 2010). European Language Resources Association (ELRA). Journal of ICT, 21, No. 4 (October) 2022, pp: 571–
Behera, R. N., & Roy, M. (2016). Ensemble based hybrid machine learning approach for sentiment classification-A review. International Journal of Computer Applications, 146(6), 31–36.
Birjali, M., Kasri, M., & Beni-Hssane, A. (2021). A comprehensive survey on sentiment analysis: Approaches, challenges and trends. Knowledge-Based Systems, 226, 107–134. https://doi.org/10.1016/j.knosys.2021.107134
Blitzer, J., Dredze, M., & Pereira, F. (2007, June). Biographies, Bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification John. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (pp. 440–447).
Chang, J.-R., Liang, H.-Y., Chen, L.-S., & Chang, C.-W. (2020). Novel feature selection approaches for improving the performance of sentiment classification. Journal of Ambient Intelligence and Humanized Computing, 1–14. https://doi.org/10.1007/s12652-020-02468-z
Diwakar, D. (2019, December). Proposed machine learning classifier algorithm for sentiment analysis. In 2019 Sixteenth International Conference on Wireless and Optical Communication Networks (WOCN) (pp. 1–6). IEEE.
Duric, A., & Song, F. (2012). Feature selection for sentiment analysis based on content and syntax models. Decision Support Systems, 53(4), 704–711. https://doi.org/10.1016/j.dss.2012.05.023
Ekbal, A., & Saha, S. (2013). Combining feature selection and classifier ensemble using a multiobjective simulated annealing approach: Application to named entity recognition. Soft Computing, 17(1), 1–16. https://doi.org/10.1007/s00500-012-0885-6
Hoque, N., Bhattacharyya, D. K., & Kalita, J. K. (2014). MIFS-ND: A mutual information-based feature selection method. Expert Systems with Applications, 41(14), 6371–6385.
Iguyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, 3, 1157–1182. https://doi.org/10.1162/153244303322753616
Kaur, R. (2017). Sentiment analysis of movie reviews: A study of machine learning algorithms with various feature selection methods. International Journal of Computer Sciences and Engineering, 5(9), 113–121. https://doi.org/10.26438/ijcse/ v5i9.113121
Kummer, O., & Savoy, J. (2012, January). Feature selection in sentiment analysis. In Conférence en Recherche d’Infomations et Applications (CORIA) (pp. 273–284). Journal of ICT, 21, No. 4 (October) 2022, pp: 571–
Ligthart, A., Catal, C., & Tekinerdogan, B. (2021). Systematic reviews in sentiment analysis: A tertiary study. Artificial Intelligence Review, 54(7), 4997–5053. https://doi.org/10.1007/s10462-021-09973-3
Liu, B. (2012). Sentiment analysis and opinion mining. In Synthesis lectures on human language technologies (pp. 1–167). Morgan & Claypool Publishers. https://doi.org/10.1142/9789813100459_0007
Manalu, B. U., Tulus., & Efendi, S. (2020, September). Deep learning performance in sentiment analysis. In 2020 4th International Conference on Electrical, Telecommunication and Computer Engineering (ELTICOM) (pp. 97–102). IEEE.
Manek, A. S., Shenoy, P. D., Mohan, M. C., & Venugopal, K. R. (2016). Aspect term extraction for sentiment analysis in large movie reviews using Gini Index feature selection method and SVM classifier. World Wide Web, 20(2), 135–154. https://doi.org/10.1007/s11280-015-0381-x
Naheed, N., Shaheen, M., Khan, S. A., Alawairdhi, M., & Khan, M. A. (2020). Importance of features selection, attributes selection, challenges and future directions for medical imaging data: A review. Computer Modeling in Engineeting & Sciences (CMES), 125(1), 315–344. https://doi.org/10.32604/cmes.2020.011380
Novaković, J., Strbac, P., & Bulatović, D. (2011). Toward optimal feature selection using ranking methods and classification algorithms. Yugoslav Journal of Operations Research, 21(1), 119–135. https://doi.org/10.2298/YJOR1101119N
Pang, B., & Lee, L. (2004, July). A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proceeding of 42nd Annual Meeting on Association for Computational Linguistics (ACL ‘04) (p. 271–278). https://doi.org/10.3115/1218955.1218990
Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2(1–2), 1–135. https://doi.org/10.3748/wjg.v22.i45.9898
Pang, B., Lee, L., & Vaithyanathan, S. (2002, July). Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 79–86).
Parlar, T., Özel, S. A., & Song, F. (2018). QER: A new feature selection method for sentiment analysis. Human-Centric Computing and Information Sciences, 8(1), 1–19. https://doi.org/10.1186/ s13673-018-0135-8 Journal of ICT, 21, No. 4 (October) 2022, pp: 571–
Rajpoot, A. K., Nand, P., & Abidi, A. I. (2021, January). A comprehensive survey on effective feature selection approaches for text sentiment classification process. In 2021 11th International Conference on Cloud Computing, Data Science & Engineering (pp. 971–977). IEEE.
Sainin, M. S., Alfred, R., & Ahmad, F. (2021). Ensemble Meta classifier with sampling and feature selection for data with multiclass imbalance problem. Journal of Information and Communication Technology, 20(2), 103–133. https://doi.org/10.32890/jict2021.20.2.1
Shahana, P. H., & Omman, B. (2015). Evaluation of features on sentimental analysis. Procedia Computer Science, 46, 1585–1592. https://doi.org/10.1016/j.procs.2015.02.088
Tang, J., Alelyani, S., & Liu, H. (2014). Feature selection for classification: A review. In C. C. Aggarwal (Ed.), Data classification: Algorithms and applications (p. 37). Chapman and Hall/CRC.
Wijesinghe, A. (2017). Sentiment analysis on movie reviews. Australian National University Technical Report–RESEARCH GATE. https://doi.org/10.13140/RG.2.2.13784.80645
Xia, R., Zong, C., & Li, S. (2011). Ensemble of feature sets and classification algorithms for sentiment classification. Information Sciences, 181(6), 1138–1152. https://doi.org/10.1016/j.ins.2010.11.023
Yousefpour, A., Ibrahim, R., & Hamed, H. N. A. (2017). Ordinal-based and frequency-based integration of feature selection methods for sentiment analysis. Expert Systems with Applications, 75, 80–93. https://doi.org/10.1016/j.eswa.2017.01.009
Yousefpour, A., Ibrahim, R., Nuzly, H., & Hamed, A. (2014a). A novel feature reduction method in sentiment analysis. International Journal of Innovative Computing, 1(4), 34–40.
Yousefpour, A., Ibrahim, R., Nuzly, H., & Hamed, A. (2014b, April). Feature reduction using standard deviation with different subsets selection in sentiment analysis. In Proceedings of the 6th Asian Conference on Intelligent Information and Database Systems (pp. 33–41). Springer, Cham. https://doi.org/10.1007/978-3-319-05458-2
Zin, H. M., Mustapha, N., Murad, M. A. A., & Sharef, N. M. (2018). Term weighting scheme effect in sentiment analysis of online movie reviews. Advanced Science Letters, 24(2), 933–937. https://doi.org/10.1166/asl.2018.10661
Published
Issue
Section
License
Copyright (c) 2022 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-16Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
