Graph-Augmented Transformer Framework for Context-Aware Recommender Systems on Amazon E-Commerce Data

Authors

  • Mohamed Badouch Faculty of Sciences, Ibn Zohr University, Morocco
  • Es-said Boulmane Faculty of Sciences, Ibn Zohr University, Morocco
  • Mehdi Boutaounte National School of Commerce and Management, Ibn Zohr University, Morocco
  • Hasna Mahmoud Faculty of Sciences, Ibn Zohr University, Morocco

DOI:

https://doi.org/10.32890/jict2026.25.2.3

Keywords:

Recommender systems, graph neural networks, context-aware recommendation, cold-start problem, e-commerce

Abstract

Recommender systems play a pivotal role in enhancing user experience and driving engagement across e-commerce platforms. However, traditional approaches such as collaborative filtering and matrix factorisation often struggle with sparse user-item interactions and fail to capture contextual nuances. To address these limitations, this paper proposes a novel hybrid framework that integrates Graph Neural Networks (GNNs) and Transformer-based architectures for context-aware recommendation. The framework first constructs a dynamic bipartite graph from user interactions and product metadata, enabling the GNN to learn relational embeddings that reflect user preferences and item similarities. These embeddings are then fused with a Transformer module that applies multi-head self-attention to model temporal and semantic patterns within user behaviour sequences. We propose a hybrid Graph-Augmented Transformer framework for context-aware recommendation, evaluated on the Amazon Reviews 2023 dataset (571M reviews, 54.5M users, 48.2M items). The model integrates graph-based relational embeddings with transformer-based sequential attention. Compared to LightGCN, SASRec, and BERT4Rec baselines, our approach achieves significant improvements in NDCG, recall, and robustness under cold-start conditions. The framework is scalable and suitable for real-time deployment, offering a practical blueprint for next-generation recommender systems. By combining graph-based relational learning with attention-driven context modelling, this research contributes a powerful and flexible solution for next-generation recommender systems.

References

Abu Bakar et al. (2025). AI-driven influencer and market analysis: A social network approach to measure E-commerce relationships. Journal of Information and Communication Technology, 24(3), 1–21. https://doi.org/10.32890/jict 2025.24.3.1

Aggarwal, C. C. (2016). Recommender systems: The textbook. Springer. https://doi.org/10.1007/978-3-319-29659-3

Bhanusree, Y., Kumar, S. S., & Rao, A. K. (2023). Time-distributed attention-layered convolution neural network with ensemble learning using random forest classifier for speech emotion recognition. Journal of Information and Communication Technology, 22(1), 49–76. https://doi.org/10.32890/jict2023.22.1.3

Chicaiza, J., & Valdiviezo-Diaz, P. (2021). A comprehensive survey of knowledge graph-based recommender systems: Technologies, development, and contributions. Information, 12(6), 232. https://doi.org/10.3390/info12060232

Da’u, A., & Salim, N. (2020). Recommendation system based on deep learning methods: A systematic review and new directions. Artificial Intelligence Review, 53, 2709–2748. https://doi.org/10. 1007/s10462-019-09744-1

Deldjoo, Y., Schedl, M., Zamani, H., & Pakdel, A. H. (2021). Content-based recommendations: A deep review and future directions. Information Processing & Management, 59(2), 102594. https://doi.org/10. 1016/j.ipm.2021.102594

Gao, C., Lei, W., He, X., de Rijke, M., & Chua, T. S. (2021). Advances and challenges in conversational recommender systems: A survey. AI Open, 2, 100–126. https://doi.org/10.1016/j.aiopen. 2021.06.002

He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., & Wang, M. (2020). LightGCN: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 639–648). ACM. https://doi.org/10.1145/3397271.3401063

He, X., Zhang, H., Kan, M. Y., & Chua, T. S. (2017). Neural collaborative filtering. In Proceedings of the 26th International World Wide Web Conference (pp. 173–182). ACM. https://doi.org/10.1145/3038912.3052569

Hidasi, B., Karatzoglou, A., Baltrunas, L., & Tikk, D. (2015). Session-based recommendations with recurrent neural networks. https://arxiv.org/abs/1511.06939

Kang, W. C., & McAuley, J. (2018). Self-attentive sequential recommendation. In Proceedings of the IEEE International Conference on Data Mining (pp. 197–206). IEEE. https://doi.org/10.1109/ ICDM.2018.00035

Kent, D., & Salem, F. (2019, August). Performance of three slim variants of the long short-term memory (LSTM) layer. In 2019, IEEE 62nd International Midwest Symposium on Circuits and Systems (MWSCAS) (pp. 307–310). IEEE. https://doi.org/10.1109/MWSCAS.2019.8885035

Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix factorization techniques for recommender systems. Computer, 42(8), 30–37. https://doi.org/10.1109/MC.2009.263

Lara-Cabrera, R., González-Prieto, Á., & Ortega, F. (2020). Deep matrix factorization approach for collaborative filtering recommender systems. Applied Sciences, 10(14), 4926. https://doi.org/10.3390/app10144926

McAuley Lab (2023). Amazon reviews 2023 dataset. UC San Diego – McAuley Lab. https://amazon-reviews-2023.github.io/

Pérez-López, D., Dueñas-Lerín, J., Ortega, F., & González-Prieto, Á. (2023). New trends in AI for recommender systems and collaborative filtering. Applied Sciences, 13(15), 8845. https://doi.org/10.3390/app13158845

Rendle, S., Freudenthaler, C., Gantner, Z., & Schmidt-Thieme, L. (2009). BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (pp. 452–461). AUAI. https://doi.org/10.48550/arXiv.1205.2618

Ricci, F., Rokach, L., & Shapira, B. (2015). Recommender systems handbook (2nd ed.). Springer. https://doi.org/10.1007/978-1-4899-7637-6

Rochin Demong, N. A., Shahrom, M., Abdul Rahim, R., Omar, E. N., & Yahya, M. (2023). Personalized recommendation classification model of students’ social well-being based on personality trait determinants using machine learning algorithms. Journal of Information and Communication Technology, 22(4), 545–585. https://doi.org/10.32890/jict2023.22.4.2

Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001). Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web (pp. 285–295). Hong Kong. https://doi.org/10.1145/371920.37207

Steck, H. (2019). Embarrassingly shallow autoencoders for sparse data. In Proceedings of The Web Conference (pp. 3251–3257). ACM. https://doi.org/10.1145/3308558.3313710

Sun et al. (2019). BERT4Rec: Sequential recommendation with bidirectional encoder representations from Transformer. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (pp. 1441–1450). ACM. https://doi.org/10.1145/3357384. 3357895

Sun, Z., Guo, J., Cheng, X., & Shen, J. (2021). A survey of session-based recommender systems. Information Processing & Management, 58(5), 102682. https://doi.org/10.1016/j.ipm.2021. 102682

Wang, J., Zhou, K., Zhang, W., & Yu, Y. (2023). A survey on knowledge graph-based recommender systems. IEEE Transactions on Knowledge and Data Engineering, 35(4), 3052–3071. https://doi.org/10.1109/TKDE.2021.3117415

Wang, X., He, X., Cao, Y., Liu, M., & Chua, T. S. (2019). KGAT: Knowledge graph attention network for recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (pp. 950–958). ACM. https://doi.org/10.1145/3292500. 3330989

Wei, X., He, X., Tang, J., & Chua, T. S. (2022). Sequential recommender systems: Challenges, progress and prospects. AI Open, 3, 1–15. https://doi.org/10.1016/j.aiopen.2022.01.001

Wu, S., Sun, F., Zhang, W., Xie, X., & Cui, B. (2022). Graph neural networks in recommender systems: A survey. ACM Computing Surveys, 55(5), 97. https://doi.org/10.1145/3523228

Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W. L., & Leskovec, J. (2018). Graph convolutional neural networks for web-scale recommender systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (pp. 974–983). ACM. https://doi.org/10.1145/3219819.3219890

Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z. (2023). Self-supervised learning for recommender systems: A survey. IEEE Transactions on Knowledge and Data Engineering, 1-20. https://doi.org/10.1109/TKDE.2023.3282907

Zhang, Q., Lu, J., & Jin, Y. (2021). Artificial intelligence in recommender systems. Complex & Intelligent Systems, 7, 439–457. https://doi.org/10.1007/s40747-020-00212-w

Zhang, Y., & Chen, X. (2020). Explainable recommendation: A survey and new perspectives. Artificial Intelligence Review, 53, 571–604. https://doi.org/10.1007/s10462-019-09777-y

Zhou, H., Xiong, F., & Chen, H. (2023). A comprehensive survey of recommender systems based on deep learning. Applied Sciences, 13(20), 11378. https://doi.org/10.3390/app132011378

Downloads

Published

30-04-2026

Issue

Vol. 25 No. 2 (2026): Journal of Information and Communication Technology (JICT) Vol.25, No.2, April 2026

Section

Articles

License

Copyright (c) 2026 Journal of Information and Communication Technology

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

Badouch, M., Boulmane, E.- said, Boutaounte, M., & Mahmoud, H. (2026). Graph-Augmented Transformer Framework for Context-Aware Recommender Systems on Amazon E-Commerce Data. Journal of Information and Communication Technology, 25(2), 50-69. https://doi.org/10.32890/jict2026.25.2.3

Research impact

Harvested 2026-09-06
0 citations recorded so far

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2026.25.2.3 OpenAlex W7161059938 Scopus 105040143477