Opinion Triplet Extraction for Aspect-Based Sentiment Analysis Using Co-Extraction Approach
DOI:
https://doi.org/10.32890/jict2022.21.2.5Keywords:
Aspect-based sentiment analysis, opinion triplet, co-extraction, Dual crOss-sharEd RNN, span-based multitaskAbstract
In aspect-based sentiment analysis, tasks are diverse and consist of aspect term extraction, aspect categorization, opinion term extraction, sentiment polarity classification, and relation extractions of aspect and opinion terms. These tasks are generally carried out sequentially using more than one model. However, this approach is inefficient and likely to reduce the model’s performance due to cumulative errors in previous processes. The co-extraction approach with Dual crOss-sharEd RNN (DOER) and span-based multitask acquired better performance than the pipelined approaches in English review data. Therefore, this research focuses on adapting the co-extraction approach where the extraction of aspect terms, opinion terms, and sentiment polarity are conducted simultaneously from review texts. The co-extraction approach was adapted by modifying the original frameworks to perform unhandled subtask to get the opinion triplet. Furthermore, the output layer on these frameworks was modified and trained using a collection of Indonesian-language hotel reviews. The adaptation was conducted by testing the output layer topology for aspect and opinion term extraction as well as variations in the type of recurrent neural network cells and model hyperparameters used, and then analysing the results to obtain a conclusion. The two proposed frameworks were able to carry out opinion triplet extraction and achieve decent performance. The DOER framework achieves better performance than the baselines on aspect and opinion term extraction tasks.
References
Azhar, A. N., Khodra, M. L., & Sutiono, A. P. (2019). Multi-label Aspect Categorization with Convolutional Neural Networks and Extreme Gradient Boosting. Proceedings of the International Conference on Electrical Engineering and Informatics. https://doi.org/10.1109/ICEEI47359.2019.8988898
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017). Enriching Word Vectors with Subword Information. Transactions of the Association for Computational Linguistics, 5, 135-146. https://doi.org/10.1162/tacl_a_00051
Chen, F, Yang, Z., & Huang, Y. (2022). A multi-task learning framework for end-to-end aspect sentiment triplet extraction. Neurocomputing,479,12—21.https://doi.org/10.1016/j neucom.2022.01.021 Journal of ICT, 21, No. 2 (April) 2022, pp: 255-
Chen, G., Ye, D., Xing, Z., Chen, J., & Cambria, E. (2017). Ensemble application of convolutional and recurrent neural networks for multi-label text categorization. Proceedings of the International Joint Conference on Neural Networks. https://doi.org/10.1109/
IJCNN.2017.7966144
Chen, G., Zhang, Q., & Di Chen. (2018). A Pair-Wise Method for Aspect-Based Sentiment Analysis. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). https://doi.org/10.1007/978-3-3 19-94307-7_2
Chen, Z., Huang, H., Liu, B., Shi, X., & Jin, H. (2021). Semantic and Syntactic Enhanced Aspect Sentiment Triplet Extraction. https://doi.org/10.18653/v 1/2021.findings-acl.128
Chollet, F., & others. (2015). Keras. https://keras.io.
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. NAACL HLT 2019. Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference.
Fernando, J., Khodra, M. L., & Septiandri, A. A. (2019). Aspect and Opinion Terms Extraction Using Double Embeddings and Attention Mechanism for Indonesian Hotel Reviews. Proceedings - 2019 International Conference on Advanced Informatics: Concepts, Theory, and Applications, ICAICTA 2019. https://doi.org/10.1109/ICAICTA.2019.8904 124
Hu, M., & Liu, B. (2004). Mining and Summarizing Customer Reviews. Proceedings of the TenthACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 168—177. https://doi.org/10.1145/1014052. 1014073
Lample, G., & Conneau, A. (2019). Cross-lingual Language Model Pretraining. Advances in Neural Information Processing Systems (NeurIPS).
Li, X., Bing, L., Lam, W., & Shi, B. (2018). Transformation networks for target-oriented sentiment classification. ACL 20/8-56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). https://doi.org/10.18653/v 1/p18-1087
Li, Y., Lin, Y., Lin, Y., Chang, L., & Zhang, H. (2022). A span-sharing joint extraction framework for harvesting aspect sentiment triplets. Knowledge-Based Systems, 242, 108366. https://doi.org/10.1016/j.knosys.2022.108366 Journal of ICT, 21, No. 2 (April) 2022, pp: 255-
Luo, H., Li, T., Liu, B., & Zhang, J. (2020). Doer: Dual cross-shared
RNN for aspect term-polarity Co-extraction. ACL 2019-57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. https://doi.org/10.18653/v 1/p19-1056 Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, L., Manandhar, S., Al-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., De Clercq, O., Hoste, V., Apidianaki, M., Tannier, X., Loukachevitch, N., Kotelnikov, E., Bel, N., Jiménez-Zafra,
S. M., & Eryigit, G. (2016). SemEval-2016 task 5: Aspect based sentiment analysis. SemEval 2016-10th International Workshop on Semantic Evaluation, Proceedings. https://doi.org/10.18653/v 1/s16-1002 Purwarianti, A., Andhika, A., Wicaksono, A. F., Afif, I1., & Ferdian,
F. (2016). InaNLP: Indonesia natural language processing toolkit, case study: Complaint tweet classification. 4th IGNITE
Conference and 2016 International Conference on Advanced Informatics: Concepts, Theory and Application, ICAICTA 2016. https://doi.org/10.1109/ICAICTA.2016.7803 103
Ren, X., Guo, H., Li, S., Wang, S., & Li, J. (2017). A novel image classification method with CNN-XGBoost model. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). https://doi.org/10.1007/978-3-319-64185-0_28 Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez,
A.N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems.
Wang, W., Pan, S. J., Dahlmeier, D., & Xiao, X. (2017). Coupled multi-layer attentions for co-extraction of aspect and opinion terms. 3/st AAAI Conference on Artificial Intelligence, AAAI 2017. Wilie, B., Vincentio, K., Winata, G.I., Cahyawijaya, S., Li, X., Lim, Z., Soleman, S., Mahendra, R., Fung, P., Bahar, S., & Purwarianti,
A. (2020). IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding. AACL. Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C.,
Le Scao, T., Gugger, S.,... Rush, A. (2020). Transformers: State-of-the-Art Natural Language Processing. https://doi.org/10.18653/v 1/2020.emnlp-demos.6 Journal of ICT, 21, No. 2 (April) 2022, pp: 255-
Xu, L., Chia, Y. K., & Bing, L. (2021). Learning span-level interactions for aspect sentiment triplet extraction. ACL-IJCNLP 2021-59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Proceedings of the Conference. https://doi.org/10.18653/v 1/2021.acl-long.367
Xu, H., Liu, B., Shu, L., & Yu, P. S. (2018). Double embeddings and cnn-based sequence labeling for aspect extraction. ACL 2018-56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). https://doi.org/10.18653/v 1/p18-2094
Xu, H., Liu, B., Shu, L., & Yu, P. S. (2019). BERT post-training for review reading comprehension and aspect-based sentiment analysis. NAACL HLT 2019-2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference. https://doi.org/10.18653/v1/N19-1242
Zhang, W., Li, X., Deng, Y., Bing, L., & Lam, W. (2021, August). Towards Generative Aspect-Based Sentiment Analysis. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) (pp. 504-510). https://doi.org/10.18653/v1/2021.acl-short.64
Zhao, H., Huang, L., Zhang, R., Lu, Q., & xue, hui. (2020). SpanMIt: A Span-based Multi-Task Learning Framework for Pair-wise Aspect and Opinion Terms Extraction. https://doi.org/10.18653/ v1/2020.acl-main.296
Published
Issue
Section
How to Cite
Research impact
Harvested 2026-09-06Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
