User Experience Dimensions for E-procurement
A Systematic Review
DOI:
https://doi.org/10.32890/jict2022.21.4.1Keywords:
User experience, UX, UX dimension, E-procurement, Systematic reviewAbstract
The use of e-procurement is needed for business transactions, especially regarding procurement activities. However, system users
always demand and expect to use the system without problems. Existing studies on e-procurement do not focus on user experience
(UX). Only a few studies have identified dimensions for UX evaluation; however, they are for e-government online services and construction. Identifying the UX dimensions for e-procurement is important for measuring user experience to provide better services. Therefore, this study attempted to investigate and determine the dimensions of user experience for e-procurement. The method for selecting articles was adopted from the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA). The study analysed the data using thematic analysis based on the Systems and software Quality Requirements and Evaluation (SQuaRE) standards, such as ISO 25022:2016 and ISO 25023:2016, as guidance. The findings showed that among the most used UX dimensions in the e-procurement literature were satisfaction, security, transparency, efficiency, and reliability. Other UX-related dimensions identified from the review were usability, compatibility, effectiveness, performance efficiency, functional suitability, attractiveness, explainability, fairness, and visibility. The study was conducted to identify the UX dimensions for e-procurement from literature studies by organising them using ISO 25022:2016 and ISO 25023:2016 standards. This study could serve as a guideline for designers, developers, and researchers to develop an e-procurement system by referring to the proposed UX dimensions to produce a positive user experience. Moreover, the findings are beneficial to practitioners on software quality attributes.
References
AbdulAzeez, A. D., Badiru, Y. Y., & Gabriel, B. B. (2015). A survey of public construction management agencies readiness for e-procurement adoption. Jurnal Teknologi, 77(15), 85–92. https://doi.org/10.11113/jt.v77.6535 Journal of ICT, 21, No. 4 (October) 2022, pp: 465–
Abdullahi, B., Ibrahim, Y. M., Ibrahim, A. D., & Bala, K. (2019). Development of web-based e-tendering system for Nigerian public procuring entities. International Journal of Construction Management, 22(2), 278–291. https://doi.org/10.1080/156235 99.2019.1620492
Aduwo, E. B., Ibem, E. O., Ayo-Vaughan, E. A., Afolabi, A. O., Uwakonye, U. O., & Oluwunmi, A. A. (2020). Determinants of e-procurement implementation in construction in Nigeria. International Journal on Emerging Technologies, 11(2), 746–755.
Aduwo, E. B., Ibem, E. O., Uwakonye, O., Tunji-Olayeni, P., & Ayo-Vuaghan, E. K. (2016). Barriers to the uptake of e-procurement in the Nigerian building industry. Journal of Theoretical and Applied Information Technology, 89(1), 133–147.
Afolabi, A., Ibem, E., Aduwo, E., Tunji-olayeni, P., Oluwunmi, O., & Ayo-vaughan, E. (2019). Gauging parameters for e-procurement acquisition in construction businesses in Nigeria. International Journal of Construction Management, 1–10. https://doi.org/10.1080/15623599.2019.1627504
Ahmad, T., Aljafari, R., & Venkatesh, V. (2019). The government of Jamaica’s electronic procurement system: Experiences and lessons learned. Internet Research, 29(6), 1571–1588. https://doi.org/10.1108/INTR-02-2019-0044
Akenroye, T. O., Owens, J. D., Elbaz, J., & Durowoju, O. A. (2020). Dynamic capabilities for SME participation in public procurement. Business Process Management Journal, 26(4), 1463–7154. https://doi.org/10.1108/BPMJ-10-2019-0447
Almogahed, A., & Omar, M. (2021). Refactoring techniques for improving software quality: Practitioners’ perspectives. Journal of Information and Communication Technology, 20(4), 511–539. https://doi.org/https://doi.org/10.32890/jict2021.20.4.3
Alnuaimi, B. K., Khan, M., & Ajmal, M. M. (2021). The role of big data analytics capabilities in greening e-procurement: A higher order PLS-SEM analysis. Technological Forecasting & Social Change, 169(November 2020), 120808. https://doi.org/10.1016/j.techfore.2021.120808
Alomar, M. A., & de Visscher, C. (2019). E-public procurement: Which factors determine its acceptance by small-to medium-sized enterprises and large companies in Belgium? International Review of Administrative Sciences, 85(2), 356–376. https://doi.org/10.1177/0020852317703466 Journal of ICT, 21, No. 4 (October) 2022, pp: 465–
Altayyar, A., & Beaumont-Kerridge, J. (2016). External factors affecting the adoption of e-procurement in Saudi Arabian’s SMEs. Procedia - Social and Behavioral Sciences, 229, 363–375. https://doi.org/10.1016/j.sbspro.2016.07.147
Alvarez-Rodríguez, J. M., Labra-Gayo, J. E., & De Pablos, P. O. (2014). New trends on e-Procurement applying semantic technologies: Current status and future challenges. Computers in Industry, 65(5), 800–820. https://doi.org/10.1016/j. compind.2014.04.005
Aminah, S., Ditari, Y., Kumaralalita, L., Hidayanto, A. N., Phusavat, K., & Anussornnitisarn, P. (2018). E-procurement system success factors and their impact on transparency perceptions: Perspectives from the supplier side. Electronic Government, 14(2), 177–199. https://doi.org/10.1504/EG.2018.090929
Ashok, S., Norfarhana, A., Tzuaan, S. S., Khean, C. ngip, Mohd Nor, Z., Rasidi, S. H., & Wai, Y. S. (2014). Measuring public value UX based on ISO / IEC 25010 quality attributes. In 3rd International Conference on User Science and Engineering (i-USEr) (pp. 56–61).
Azmi, K. S. A., & Rahman, A. A. L. A. (2015). E-procurement: A tool to mitigate public procurement fraud in Malaysia? The Electronic Journal of E-Government, 13(2), 150–160. www. ejeg.com
Barahona, J. C., Elizondo, A. M., & Santos, M. (2015). The dilemma of public e-procurement in Costa Rica: Case on the duality of technological platforms and implementation models. Journal of Information Technology Teaching Cases, 5(2), 57–64. https://doi.org/10.1057/jittc.2015.7
Basri, N. H., Adnan, W. A. W., & Baharin, H. (2019). E-participation service in Malaysian e-government website: The user experience evaluation. In Proceedings of the 10th International Conference on E-Education, E-Business, E-Management and E-Learning (pp. 342–346). https://doi.org/10.1145/3306500.3306569
Bienhaus, F., & Haddud, A. (2018). Procurement 4.0: Factors influencing the digitisation of procurement and supply chains. Business Process Management Journal, 24(4), 965–984. https://doi.org/10.1108/BPMJ-06-2017-0139
Brandon-Jones, A., & Kauppi, K. (2018). Examining the antecedents of the technology acceptance model within e-procurement. International Journal of Operations and Production Management, 38(1), 22–42. https://doi.org/10.1108/ IJOPM-06-2015-0346 Journal of ICT, 21, No. 4 (October) 2022, pp: 465–
Charpin, R., Kyung Lee, M., & Wu, T. (2021). Mobile procurement platforms: Bridging the online and offline worlds in China’s restaurant industry. International Journal of Production Economics, 241(August 2020), 108256. https://doi.org/10.1016/j.ijpe.2021.108256
Chen, Y., Bretschneider, S., Stritch, J. M., Darnall, N., & Hsueh, L. (2021). E-procurement system adoption in local governments: The role of procurement complexity and organizational structure. Public Management Review, 1–23. https://doi.org/1 0.1080/14719037.2021.1874497
Choi, H., Parl, M. J., Rho, J. J., & Zo, H. (2016). Rethinking the assessment of e-government implementation in developing countries from the perspective of the design–reality gap: Applications in the Indonesian e-procurement system. Telecommunications Policy, 40(7), 644–660. https://doi.org/10.1016/j.telpol.2016.03.002
Crescenzi, A., Kelly, D., & Azzopardi, L. (2016). Impacts of time constraints and system delays on user experience. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval (pp. 141–150). ACM.
Díaz-oreiro, I., López, G., Quesada, L., & Guerrero, L. A. (2019). Standardized questionnaires for user experience evaluation: A systematic literature review. In 13th International Conference on Ubiquitous Computing and Ambient Intelligence (UCAmI 2019) (pp. 1–12). https://doi.org/10.3390/proceedings2019031014
Dmytryshyn, B., Zhovnovach, R., Levchenko, O., Malakhovskyi, Y., & Gonchar, V. (2018). Practical aspects of assessing the efficiency of the modern system of public procurement in Ukraine. Problems and Perspectives in Management, 16(2), 353–363. https://doi.org/10.21511/ppm.16(2).2018.32
Hasim, W., Wibirama, S., & Nugroho, H. A. (2019). Redesign of E-participation using user-centered design approach for improving user experience. In 2019 International Conference on Information and Communications Technology (ICOIACT 2019) (pp. 857–861). https://doi.org/10.1109/ ICOIACT46704.2019.8938545
Hokkanen, L., Xu, Y., & Väänänen, K. (2016). Focusing on user experience and business models in startups: Investigation of two-dimensional value creation. In Proceedings of the 20th International Academic Mindtrek Conference (pp. 59–67). https://doi.org/https://doi.org/10.1145/2994310.2994371 Journal of ICT, 21, No. 4 (October) 2022, pp: 465–
Hong, Y., & Shao, B. B. M. (2020). On factors that moderate the effect of buyer-supplier experience on e-procurement platforms. Production and Operations Management, 1–18. https://doi.org/10.1111/poms.13291
Ibem, E. O., Aduwo, E. B., Afolabi, A. O., Adedamola, O., Tunji-Olayeni, P. F., Ayo-Vaughan, E. A., & Uwakonye, U. O. (2020). Electronic (e-) procurement adoption and users’ experience in the Nigerian construction sector. International Journal of Construction Education and Research, 17(3), 258–276. https://doi.org/10.1080/15578771.2020.1730527
Ibem, E. O., & Laryea, S. (2015). E-procurement use in the South African construction industry. Journal of Information Technology in Construction, 20, 364–384.
Imamoglu, M. Y., & Rehan, M. (2015). Cost analysis of interoperable based e-procurement system in the Republic of Turkey. In Proceedings of the International Conference on Engineering & MIS 2015 (pp. 1–7). https://doi.org/http://dx.doi. org/10.1145/2832987.2832999
International Organisation for Standardisation (ISO). (2016a). Systems and software enginnering - Systems and software quality requirements and evaluation (SQuaRE) - Measurement of quality in use (ISO Standard No. 25022:2016).
International Organisation for Standardisation (ISO). (2016b). Systems and software enginnering - Systems and software quality requirements and evaluation (SQuaRE) - Measurement of system and software product quality (ISO Standard No. 25023:2016).
Kamau, G., Njihia, M., Wausi, A., Njihia, J., & Wausi, A. (2016). E-government websites user experience from public value perspective: Case study of iTax website in Kenya. In 2016 IST-Africa Week Conference (pp. 1–8). https://doi.org/10.1109/ ISTAFRICA.2016.7530631
Koggalage, P. D., Lanka, S., Dassanayake, K. M. D., & Kulasuriya, P. K. S. S. (2022). Implementation of e-procurement for pharmaceuticals: Perspectives of the staff of the State Pharmaceuticals Corporation of Sri Lanka. International Journal of Procurement Management, 15(1), 113–131. https://doi.org/10.1504/IJPM.2022.119841
Kosmol, T., Reimann, F., & Kaufmann, L. (2019). You’ll never walk alone: Why we need a supply chain practice view on digital procurement. Journal of Purchasing and Supply Management, 25(4), 100553. https://doi.org/10.1016/j.pursup.2019.100553 Journal of ICT, 21, No. 4 (October) 2022, pp: 465–
Kumar, N., & Ganguly, K. K. (2020). Non-financial e-procurement performance measures: Their interdependence and impact on production cost. International Journal of Productivity and Performance Management, 1–24. https://doi.org/10.1108/ IJPPM-07-2019-0353
Lee, H., Lee, K. K., & Choi, J. (2018). A structural model for unity of experience: Connecting user experience, customer experience, and brand experience. Journal of Usability Studies, 14(1), 8–34.
Liliana, D. Y., Basaruddin, T., Rahmat, M., & Dian Oriza, I. I. (2020). High-level fuzzy linguistic features of facial component for human emotion recognition. Journal of Information and Communication Technology, 19(1), 103–129. https://doi.org/https://doi.org/10.32890/jict2020.19.1.5
Luther, L., Tiberius, V., & Brem, A. (2020). User experience (UX) in business, management, and psychology: A bibliometric mapping of the current state of research. Multimodal Technologies and Interaction, 4(18), 1–19. https://doi.org/10.3390/mti4020018
Maleki, M., Karimi, M., Reyan, H., & Cruz-Machado, V. (2017). E-procurement platform implementation feasibility study and challenges: A practical approach in Iran. In J. Xu et al. (Ed.), Proceedings of the Tenth International Conference on Management Science and Engineering Management, Advances in Intelligent Systems and Computing (Vol. 502, pp. 843–855). https://doi.org/10.1007/978-981-10-1837-4_70
Morales, J., Rusu, C., Botella, F., & Quiñones, D. (2019). Programmer eXperience : A systematic literature review. IEEE Access, 7, 71079–71094. https://doi.org/10.1109/ACCESS.2019.2920124
Müller, A., Anke, S., Herrmann, S., Katz, P., Leuchtweis, C., Miclau, C., Wörner, S., & Korn, O. (2018). Measuring the influence of user experience on banking customers’ trust. In International Conference on HCI in Business, Government, and Organizations (pp. 1–14). Springer.
Nanang, H., Durachman, Y., Subchi, I., Misman, A. F., & Zulkifli, Z. (2018). Factors that affect the e-government procurement trust in Indonesia. In 2018 6th International Conference on Cyber and IT Service Management (CITSM) (pp. 1–5). https://doi.org/10.1109/CITSM.2018.8674299
Nawi, M. N. M., Deraman, R., Bamgbade, J. A., Zulhumadi, F., & Riazi, S. R. M. (2017). E-procurement in Malaysian construction industry: Benefits and challenges in implementation. International Journal of Supply Chain Management, 6(1), 209–213. Journal of ICT, 21, No. 4 (October) 2022, pp: 465–
Norman, D., & Nielsen, J. (2020). The definition of user experience (UX). Nielsen Norman Group Publication. https://www. nngroup.com/articles/definition-user-experience/
Oluka, P., Mugurusi, G., Adoko, P., & Awuor, E. (2022). Human-centered artificial intelligence for the public sector: The gate keeping role of the public procurement professional. Procedia Computer Science, 200(2019), 1084–1092. https://doi.org/10.1016/j.procs.2022.01.308
Paredes, R. K., & Hernandez, A. A. (2017). Measuring the quality of user experience on web services: A case of university in the Philippines. In 2017 IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM) (pp. 1–6). https://doi.org/10.1109/ HNICEM.2017.8269446
Prakoso, B. S., & Subriadi, A. P. (2018). User experience on e-government online services: A case study on the SIMPATIKA service application at the Ministry of Religious Affairs of Indonesia. Journal of Information Technology and Computer Science, 3(1), 67–76. https://doi.org/10.25126/jitecs.20183152
Rakotonirina, V., & Raoelson, H. (2016). The e-procurement condition of sustained development : Case of Madagascar. In Proceedings of the 9th International Conference on Theory and Practice of Electronic Governance (pp. 392–393). https://doi.org/http://dx.doi.org/10.1145/2910019.2910066
Ramkumar, M., Schoenherr, T., Wagner, S. M., & Jenamani, M. (2019). Q-TAM: A quality technology acceptance model for predicting organizational buyers’ continuance intentions for e-procurement services. International Journal of Production Economics, 216, 333–348. https://doi.org/10.1016/j. ijpe.2019.06.003
Sandler, J. (2015). What users want: Functional user experience. In 2015 International Conference on Interactive Collaborative Learning (ICL) (pp. 355–360). https://doi.org/10.1109/ ICL.2015.7318053
Sari, C. N., Moch, B. N., Nabilah, A. Z., & Muslim, E. (2020). Strategy for readiness and intention of the use of e-procurement in welcoming Industry 4.0 study case: PX Company. In Proceedings of the 6th International Conference on Industrial and Business Engineering (pp. 20–24). https://doi.org/https://doi.org/10.1145/3429551.3429562 Journal of ICT, 21, No. 4 (October) 2022, pp: 465–
Seo, D. B., Tan, C. W., & Warman, G. (2018). Vendor satisfaction of e-government procurement systems in developing countries: An empirical research in Indonesia. Information Technology for Development, 24(3), 554–581. https://doi.org/10.1080/026 81102.2018.1454878
Shaffril, H. A. M., Samah, A. A., Samsuddin, S. F., & Ali, Z. (2019). Mirror-mirror on the wall, what climate change adaptation strategies are practiced by the Asian’s fishermen of all? Journal of Cleaner Production, 232, 104–117. https://doi.org/10.1016/j. jclepro.2019.05.262
Sharabati, M. M. N., Sulaiman, A., & Mohd Salleh, N. A. (2015). End user satisfaction and individual performance assessments in e-procurement systems. International Journal of Computer Theory and Engineering, 7(6), 503–509. https://doi.org/10.7763/ijcte.2015.v7.1010
Sierra-Correa, P. C., & Cantera Kintz, J. R. (2015). Ecosystem-based adaptation for improving coastal planning for sea-level rise: A systematic review for mangrove coasts. Marine Policy, 5, 385–393. https://doi.org/10.1016/j.marpol.2014.09.013
Singh, P. K., & Chan, S. W. (2022). The impact of electronic procurement adoption on green procurement towards sustainable supply chain performance-evidence from Malaysian ISO organizations. Journal of Open Innovation: Technology, Market, and Complexity, 8(2), 1–27.
Sugianto, Salman, M., & Suryanto, Y. (2019). Analysis and development of information security framework for distributed e-procurement system. In International Conference on Electrical Engineering, Computer Science and Informatics (EECSI) (pp. 211–216). https://doi.org/10.23919/ EECSI48112.2019.8976944
Sukmasetya, P., Santoso, H. B., & Sensuse, D. I. (2018). Current e-government public service on user experience perspective in Indonesia. In 2018 International Conference on Information Technology Systems and Innovation (ICITSI) (pp. 159–164). https://doi.org/10.1109/ICITSI.2018.8695962
Sunmola, F. T., & Shehu, Y. U. (2020). A case study on performance features of electronic tendering systems. Procedia Manufacturing, 51, 1586–1591. https://doi.org/10.1016/j. promfg.2020.10.221
Torvinen, H., & Ulkuniemi, P. (2016). End-user engagement within innovative public procurement practices: A case study on public–private partnership procurement. Industrial Journal of ICT, 21, No. 4 (October) 2022, pp: 465– Marketing Management, 58(October 2016), 58–68. https://doi.org/10.1016/j.indmarman.2016.05.015
Tullis, T., & Albert, B. (2013). Measuring the user experience: collecting, analyzing, and presenting usability metrics: Second edition (2nd ed.; M. Dunkerley, Ed.). https://doi.org/10.1016/ C2011-0-00016-9
van Staden, C. J., van Biljon, J. A., & Kroeze, J. H. (2015). eModeration: Towards a user experience evaluation framework. In Proceedings of the 2015 Annual Research Conference on South African Institute of Computer Scientists and Information Technologists (pp. 1–11). https://doi.org/https://doi.org/10.1145/2815782.2815821
Wan Nooraishya, W. A., & Nazlena, M. A. (2018). The impact of persuasive technology on user emotional experience and user experience over time. Journal of Information and Communication Technology, 17(4), 601–628.
Wang, Q., Zhang, R., & Liu, J. (2020). Price/time/intellectual efficiency of procurement: Uncovering the related factors in Chinese public authorities. Journal of Purchasing and Supply Management, 26(3), 100622. https://doi.org/10.1016/j. pursup.2020.100622
Younger, P. (2010). Using Google Scholar to conduct a literature search. Nursing Standard, 24(45), 40–46. https://doi.org/10.7748/ns2010.07.24.45.40.c7906
Yusof, N., Hashim, N. L., & Hussain, A. (2022). A conceptual user experience evaluation model on online systems. International Journal of Advanced Computer Science and Applications, 13(1), 428–438.
Published
Issue
Section
License
Copyright (c) 2022 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-06Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
