Improving E-Commerce Application Through Sense of Agency of a Calibrated Interactive VR Application

Authors

  • Nurul Aiman Abdul Rahim Pervasive Computing & Educational Technology, Fakulti Teknologi Maklumat dan Komunikasi, Universiti Teknikal Malaysia Melaka, Malaysia
  • Mohd Adili Norasikin Pervasive Computing & Educational Technology, Fakulti Teknologi Maklumat dan Komunikasi, Universiti Teknikal Malaysia Melaka, Malaysia
  • Zulisman Maksom Pervasive Computing & Educational Technology, Fakulti Teknologi Maklumat dan Komunikasi, Universiti Teknikal Malaysia Melaka, Malaysia

DOI:

https://doi.org/10.32890/jict2022.21.3.2

Keywords:

Virtual environment, sense of agency, virtual hand, online shopping

Abstract

Virtual Reality (VR) technologies create and control different virtual world instead of the actual environment, and this contributes to the feeling of control known as the sense of agency (SoA). The SoA exists from the contrast between the expected sensory consequence of one’s action from efference copy and the real sensory effects. However, the size representation of objects differs between the physical and virtual world due to certain technical limitations, such as the VR application’s virtual hand not reflecting the user’s actual hand size. A limitation that will incur low quality of perception and SoA for digital application. Here, we proposed a proof-of-concept of an interactive e-commerce application that incorporates VR capability and size calibration mechanism. The mechanism uses a calibration method based on the reciprocal scale factor from the virtual object to its real counterpart. The study of the SoA focusing on user perception and interaction was done. The proposed method was tested on twenty two participants − who are also online shopping users. Nearly half of the participants (45%) buy online products frequently, at least one transaction per day. The outcome indicates that our proposed method improves 47% of user perception and interaction compared to the conventional e-commerce application with its static texts and images. Our proposed method is rudimentary yet effective and can be easily implemented in any digital field.

References

Abu Bakar, J. A., Othman, Z., Yaakub, A. R., & Zulkifli, A. N. (2003). Reconstruction of virtual environment using CAD-VR approach. Journal of Information and Communication Technology, 2(1), 53–66. http://e-journal.uum.edu.my/index. php/jict/article/view/8019

Argelaguet, F., Hoyet, L., Trico, M., & Lécuyer, A. (2016). The role of interaction in virtual embodiment: Effects of the virtual hand representation. In IEEE Virtual Reality Conference 2016 (pp. 3–10).

Aslandere, T., Dreyer, D., & Pankratz, F. (2015). Virtual hand-button interaction in a generic virtual reality flight simulator. In IEEE Conference on Virtual Reality and 3D User Interfaces (pp. 1 –8).

Bergström, J., Mottelson, A., & Knibbe, J. (2019, October). Resized grasping in VR: Estimating thresholds for object discrimination. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (pp. 1117–1183).

Canales, R., Normoyle, A., Sun, Y., Ye, Y., Luca, M. D., & Jörg, S. (2019). Virtual grasping feedback and virtual hand ownership. In ACM Symposium on Applied Perception 2019 (pp. 1–9). https://doi.org/10.1145/3343036.3343132

Clark, A., & Moodley, D. (2016). A system for a hand gesture-manipulated virtual reality environment. In Proceedings of the Annual Conference of the South African Institute of Computer Scientists and Information Technologists (1–10). https://doi.org/10.1145/2987491.2987511

Cornelio Martinez, P. I., Maggioni, E., Hornbæk, K., Obrist, M., & Subramanian, S. (2018). Beyond the Libet clock: Modality variants for agency measurements. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–14). https://doi.org/10.1145/3173574.3174115

Cornelio, P., Maggioni, E., Brianza, G., Subramanian, S., & Obrist, M. (2020). SmellControl: The study of sense of agency in smell. In Proceedings of the 2020 International Conference on Multimodal Interaction (pp. 470–480). https://doi.org/10.1145/3382507.3418810

Day, B., Ebrahimi, E., Hartman, L. S., Pagano, C. C., Robb, A. C., & Babu, S. V. (2019). Examining the effects of altered avatars on perception-action in virtual reality. Journal of Experimental Psychology: Applied, 25(1), 1. Journal of ICT, 21, No. 3 (July) 2022, pp: 315–

Dewez, D., Hoyet, L., Lécuyer, A., & Argelaguet Sanz, F. (2021). Towards “avatar-friendly” 3D manipulation techniques: Bridging the gap between sense of embodiment and interaction in virtual reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1 –14).

Duarte, P., & Costa e Silva, S. (2018). How convenient is it? Delivering online shopping convenience to enhance customer satisfaction and encourage e-WOM. Journal of Retailing and Consumer Services, 44, 161–169. https://doi.org/10.1016/j. jretconser.2018.06.007

Griffin, W. B., Griffin, W. B., Findley, R. P., Turner, M. L., & Cutkosky, M. R. (2000). Calibration and mapping of a human hand for dexterous telemanipulation. ASME International Mechanical Engineering Congress and Exposition, 26652, 1145–1152. (American Society of Mechanical Engineers).

Hoyet, L., & Argelaguet, F. (2016). “Wow! I have six fingers!”: Would you accept structural changes of your hand in VR?. Frontiers in Robotics and AI, 3(27). https://doi.org/10.3389/ frobt.2016.00027

Jeannerod, M. (2003). The mechanism of self-recognition in humans. Behavioural Brain Research, 142(1–2), 1–15. https://doi.org/https://doi.org/10.1016/s0166-4328(02)00384-4

Jeunet, C., Albert, L., Argelaguet, F., & Lecuyer, A. (2018). “Do you feel in control?”: Towards novel approaches to characterise, manipulate and measure the sense of agency in virtual environments. IEEE Trans Vis Comput Graph, 24(4), 1486–1495. https://doi.org/10.1109/TVCG.2018.2794598

Jung, S., Bruder, G., Wisniewski, P. J., Sandor, C., & Hughes, C. E. (2018). Over my hand: Using a personalized hand in VR to improve object size estimation, body ownership, and presence. In Proceedings of the Symposium on Spatial User Interaction (pp. 60–68). https://doi.org/10.1145/3267782.3267920

Kilteni, K., & Groten, R. (2012). The sense of embodiment in virtual reality. Presence: Teleoperators and Virtual Environments, 21(4), 373–387. https://doi.org/10.1162/PRES_a_00124

Kilteni, K., & Maselli, A. (2015). Over my fake body: Body ownership illusions for studying the multisensory basis of own-body perception. Frontiers in Human Neuroscience, 9(141). https://doi.org/10.3389/fnhum.2015.00141

Kim, J., & Interrante, V. (2017). Dwarf or giant: The influence of interpupillary distance and eye height on size perception in virtual environments. In Proceedings of the 27th International Journal of ICT, 21, No. 3 (July) 2022, pp: 315– Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments, EGVE 2017 (pp. 153–160).

Linkenauger, S. A., Bulthoff, H. H., & Mohler, B. J. (2015). Virtual arm’s reach influences perceived distances but only after experience reaching. Neuropsychologia, 70, 393–401. https://doi.org/10.1016/j.neuropsychologia.2014.10.034

Ma, K., & Hommel, B. (2015). The role of agency for perceived ownership in the virtual hand illusion. Conscious Cogn, 36, 277–288. https://doi.org/10.1016/j.concog.2015.07.008

Martinez Cornelio, P. I., De Pirro, S., Vi, C. T., & Subramanian, S. (2017). Agency in mid-air interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 2426–2439). https://doi.org/10.1145/3025453.3025457

Nasibov, E., Demir, M., & Vahaplar, A. (2019). A fuzzy logic apparel size decision methodology for online marketing. International Journal of Clothing Science and Technology, 31(2), 299–315. https://doi.org/10.1108/ijcst-06-2018-0077

Ogawa, N., Narumi, T., & Hirose, M. (2018). Object size perception in immersive virtual reality: Avatar realism affects the way we perceive. In IEEE Conference on Virtual Reality and 3D User Interfaces (pp. 647–648).

Ogawa, N., Narumi, T., & Hirose, M. (2019). Virtual hand realism affects object size perception in body-based scaling. In IEEE Conference on Virtual Reality and 3D User Interfaces (pp. 519–528).

Park, H., Faghihi, N., Dixit, M., Vaid, J., & McNamara, A. (2021). Judgments of object size and distance across different virtual reality environment: A preliminary study. Applied Sciences, 11(23), 11510.

Patel, V. (2015). 3D visualization of products for online shopping. International Journal of Computer Applications, 132(5), 35–39.

Rathnayake, W. P. (2018). Usage of mixed reality for military simulations. In 2018 International Conference on Current Trends towards Converging Technologies (ICCTCT) (pp. 1–5). https://doi.org/10.1109/ICCTCT.2018.8550993

Romli, R., Shiratuddin, M. F., & Hashim, S. (2003). The virtual chemistry lab (VC-L): Virtual reality as a learning tool for Malaysia’s secondary school. Journal of Information and Journal of ICT, 21, No. 3 (July) 2022, pp: 315– Communication Technology, 2(1), 81–92. http://e-journal.uum. edu.my/index.php/jict/article/view/8021

Sait, M. S. M. Y., Sargunam, S. P., Han, D. T., & Ragan, E. D. (2018). Physical hand interaction for controlling multiple virtual objects in virtual reality. In Proceedings of the 3rd International Workshop on Interactive and Spatial Computing (pp. 64–74). https://doi.org/10.1145/3191801.3191814

Sanchez-Vives, M., & Slater, M. (2005). From presence to consciousness through virtual reality. Nature Reviews Neuroscience, 6(4), 332–339. https://doi.org/https://doi.org/10.1038/nrn1651

Shawn. (2020). IDC reveals 2021 worldwide digital transformation predictions; 65% of global GDP digitalized by 2022, driving over $6.8 trillion of direct DX investments from 2020 to 2023. https://www.idc.com/getdoc.jsp?containerId=prUS46967420

Speicher, M., Speicher, M., Hell, P., Daiber, F., Simeone, A., & Krüger, A. (2018). A virtual reality shopping experience using the apartment metaphor. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces (pp. 1–9). https://doi.org/10.1145/3206505.3206518

Thompson, S. (2020). VR applications: 21 industries already using virtual reality. Virtual Speech. https://virtualspeech.com/blog/ vr-applications

Wang, H., Jiang, S., & Wu, J. (2018). A virtual reality based simulator for training surgical skills in procedure of catheter ablation. In IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (pp. 247–248). https://doi.org/10.1109/ aivr.2018.00057

Wilson, B., Wilson, B., Bounds, M., & Tavakkoli, A. (2016). Hand motion calibration and retargeting for intuitive object manipulation in immersive virtual environments. In 2016 IEEE Virtual Reality (VR) (pp. 313–314).

Witt, J. K. (2011). Action’s effect on perception. Current Directions in Psychological Science, 20(3), 201–206. https://doi.org/10.1177/0963721411408770

Young, M. K., Rieser, J. J., & Bodenheimer, B. (2015). Dyadic interactions with avatars in immersive virtual environments: High fiving. In Proceedings of the ACM SIGGRAPH Symposium on Applied Perception, Tübingen, Germany (pp. 119–126). https://doi.org/10.1145/2804408.2804410

Downloads

Published

17-07-2022

How to Cite

Abdul Rahim, N. A., Norasikin, M. A., & Maksom, Z. (2022). Improving E-Commerce Application Through Sense of Agency of a Calibrated Interactive VR Application. Journal of Information and Communication Technology, 21(3), 315-335. https://doi.org/10.32890/jict2022.21.3.2

Research impact

Harvested 2026-09-05
5 citations, from Scopus — the highest of the sources checked

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2022.21.3.2 OpenAlex W4285803751 Scopus 85134721887