Inclusivity in Mobile Shopping Apps: An Emphasis on Learnability Checklists in Conducting a Heuristic Evaluation
DOI:
https://doi.org/10.32890/jdsd2023.1.5Keywords:
Learnability Checklists, Heuristic Evaluation, Mobile Shopping AppsAbstract
Studies on heuristic evaluation of mobile applications have been an emerging domain. However, existing checklists are too general and unable to clearly define the measurements for evaluating mobile shopping applications. This paper proposes suitable heuristics under the learnability measure for a checklist in conducting heuristic evaluation in supporting the inclusivity of a mobile shopping application. This study was conducted in two phases: generate the learnability measures based on heuristics and sub-heuristics from content analysis and verify the proposed heuristic evaluation checklist from the learnability measures through expert reviews. As a result, a verified Learnability checklist consisting of three heuristics was selected: recognition rather than recall, user control and freedom and match between the system and the real world. For each heuristic, suitable sub-heuristics and evaluation questions were identified. Through the learnability checklist, usability experts and analysts can consistently perform their evaluation during heuristics evaluation on other mobile shopping apps. This is to ensure that the apps have all relevant features that enhance the learning ability of their users, using the apps confidently and proficiently, providing their contentment in every usage scenario.
References
Abubakar, H. I., Hashim, N. L., & Hussain, A. (2016). Usability evaluation model for mobile banking applications interface: Model evaluation process using experts’ panel. Journal of Telecommunication, Electronic and Computer Engineering, 8(10), 53–57.
Adler, Michael, & Ziglio Erio. (1996). Gazing into the oracle: The Delphi method and its application to social policy and public health. Jessica Kingsley Publishers.
Baharuddin, R., Singh, D., & Razali, R. (2013). Usability Dimensions for Mobile Applications Review. Research Journal of Applied Sciences, Engineering and Technology, 5(6), 2225–2231.
Beecham, S., Hall, T., Britton, C., Cottee, M., & Rainer, A. (2005). Using an Expert Panel to Validate a Requirements Process Improvement Model. Journal of Systems and Software, 76(3), 251–275.
Beyk, B. (2015). Enhancing the usability of e-commerce platforms by utilising the usability factors: An investigation into user preferences. Retrieved from http://www.diva-portal.org/smash/record.jsf?pid=diva2:846482
Coursaris, C. K., & Kim, D. J. (2011). A Meta-Analytical Review of Empirical Mobile Usability Studies. Journal of Usability Studies, 6(3), 117-171.
Dourado, M. A. D., & Canedo, E. D. (2018). Usability heuristics for mobile applications: A systematic review. ICEIS 2018 - Proceedings of the 20th International Conference on Enterprise Information Systems, 2. https://doi.org/10.5220/0006781404830494
Goh, K. N., Chen, Y. Y., Lai, F. W., Daud, S. C., Sivaji, A., & Soo, S. T. (2013). A comparison of usability testing methods for an e-commerce website: A case study on a Malaysia online gift shop. Proceedings of the 2013 10th International Conference on Information Technology: New Generations (ITNG), 1, 143–150. https://doi.org/10.1109/ITNG.2013.129.
Harrison, R., Flood, D., & Duce, D. (2013). Usability of mobile applications: literature review and rationale for a new usability model. Journal of Interaction Science, 1(1), 1. https://doi.org/10.1186/2194-0827-1-1
Hasan, L. (2009). Usability evaluation framework for e-commerce websites in developing countries. PhD thesis, Institutional Repository, Loughborough University, Loughborough, UK.
Hasan, L., Morris, A., & Probets, S. (2013). E-commerce websites for developing countries - A usability evaluation framework. Online Information Review, 37(2), 231–251. https://doi.org/10.1108/OIR-10-2011-0166
Pierotti, D. (1995). Heuristic Evaluation System Checklist. Retrieved from https://uxmanager.net/heuristics/xerox-13-usability-heuristics
Hussain, A., Mkpojiogu, E. O. C., Suleiman, K., & Alhussian, H. (2018). A heuristic evaluation of a mobile print and design shopping application. Journal of Advanced Research in Dynamical and Control Systems, 10(10 Special Issue), 1457–1462.
Hussain, A. Bin, Aldeen, S., Abbas, A., Abdulwaheed, M. S., Mohammed, R. G., & Abdullah Abdulhussein, A. (2015). Usability Evaluation of Mobile Game Applications: A Systematic Review. International Journal of Computer and Information Technology, 4(3), 547–551.
Joyce G., Lilley M., Barker T., & Jefferies, A. (2017). Mobile Application Usability Heuristics: Decoupling Context-of-Use. In: Marcus A., Wang W. (eds) Design, User Experience, and Usability: Theory, Methodology, and Management. DUXU 2017. Lecture Notes in Computer Science, vol. 10288. Springer, Cham. https://doi.org/10.1007/978-3-319-58634-2_30.
Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele University, UK and National ICT Australia.
Komuro, M., & Komoda, N. (2008). An Explanation Model for Quality Improvement Effect of Peer Reviews. International Conference on Computational Intelligence for Modelling Control & Automation, 1159–1164. https://doi.org/10.1109/CIMCA.2008.187
Mohamed, S. F. P. (2015). A Process-Based Approach Software Certification Model for Agile Secure Environment. A PhD thesis. Universiti Utara Malaysia.
Mugisha, A., Nankabirwa, V., Tylleskär, T., & Babic, A. (2019). A usability design checklist for Mobile electronic data capturing forms: the validation process. BMC Medical Informatics and Decision Making, 19(1), 4. https://doi.org/10.1186/s12911-018-0718-3
Muhanna, M. A., Amro, R. N., & Qusef, A. (2020). Using a new set of heuristics in evaluating Arabic interfaces. Journal of King Saud University Computer and Information Sciences, 32(2), 248–253. https://doi.org/https://doi.org/10.1016/j.jksuci.2018.05.014
Nathan, S. S., Hussain, A., Hashim, N. L., & Omar, M. A. (2017). Dimensions for hearing-impaired mobile application usability model. AIP Conference Proceedings, 1891. https://doi.org/10.1063/1.5005441
Nielsen, J. (1993). Usability Engineering (1st ed.). Morgan Kaufmann.
Nielsen, J. (1994). 10 Usability Heuristics for User Interface Design. Https://www.nngroup.Com/Articles/Ten-Usability-Heuristics/.
Nielsen, P., & Hanseth, O. (2010). Association for Information Systems Towards a Design Theory of Usability and Generativity Recommended Citation. http://aisel.aisnet.org/ecis2010http://aisel.aisnet.org/ecis2010/39
Nielsen, J. (2012, January 3). Usability 101: Introduction to Usability. Nielsen Norman Group.
Omar, K., Rapp, B., & Gómez, J. M. (2016). Heuristic evaluation checklist for mobile ERP user interfaces. 7th International Conference on Information and Communication Systems (ICICS), 180–185. https://doi.org/10.1109/IACS.2016.7476107
Panduwiyasa, H., Saputra, M., Azzahra, Z. F., & Aniko, A. R. (2021). Accounting and Smart System: Functional Evaluation of ISO/IEC 25010:2011 Quality Model (a Case Study). IOP Conference Series: Materials Science and Engineering, 1092(1), 012065. https://doi.org/10.1088/1757-899x/1092/1/012065
Petrovčič, A., Taipale, S., Rogelj, A., & Dolničar, V. (2018). Design of Mobile Phones for Older Adults: An Empirical Analysis of Design Guidelines and Checklists for Feature Phones and Smartphones. International Journal of Human–Computer Interaction, 34(3), 251–264. https://doi.org/10.1080/10447318.2017.1345142
Roda, C., Navarro, E., Zdun, U., López-Jaquero, V., Simhandl, G. (2018). Past and Future of Software Architectures for Context-Aware Systems: A Systematic Mapping Study. Journal of Systems and Software, 146, 310-355.
Sagar, K., & Saha, A. (2017). A systematic review of software usability studies. International Journal of Information Technology. https://doi.org/10.1007/s41870-017-0048-1
Salah, M. S., Jusoh, S., & Muhanna, M. A. (2019). The Development of Usability Heuristics for Arabic M-Commerce Applications. 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT), 779–784. https://doi.org/10.1109/JEEIT.2019.8717474
Salman, H. M., Wan Ahmad, W. F., & Sulaiman, S. (2019). Usability evaluation of smartphone gestures in supporting elderly users. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Bioinformatics), 11870 LNCS. https://doi.org/10.1007/978-3-030-34032-2_
Seffah, A., Donyaee, M., Kline, R. B., & Padda, H. K. (2006). Usability measurement and metrics: A consolidated model. Software Quality Journal, 14(2), 159–178. https://doi.org/10.1007/s11219-006-7600-8
Shirogane, J., Matsuzawa, M., Iwata, H., & Fukazawa, Y. (2018). Usability evaluation method of applications for mobile computers using operation histories. IEICE Transactions on Information and Systems, 1790–1800. https://doi.org/10.1587/transinf.2017KBP0022.
Swaid, S. I., & Suid, T. Z. (2019). Usability Heuristics for M-Commerce Apps. In T. Z. Ahram & C. Falcão (Eds.), Advances in Usability, User Experience and Assistive Technology (pp. 79–88). Springer International Publishing.
Uzoma, I. R. (2022). A heuristic evaluation checklist for mobile shopping applications. Master Thesis. Universiti Utara Malaysia. https://etd.uum.edu.my/10282/1/s824420_01.pdf
Wangenheim, C. G., Witt, T. A., Borgatto, A. F., Nunes, J. V., Lacerda, T. C., Krone, C., & De Oliveira Souza, L. (2016). A usability score for mobile phone applications based on heuristics. International Journal of Mobile Human-Computer Interaction, 8(1), 23–58. https://doi.org/10.4018/IJMHCI.2016010102.
Wohlin, C., Mendes, E., Felizardo, K. R., & Kalinowski, M. (2020). Guidelines for the search strategy to update systematic literature reviews in software engineering. Information and Software Technology, 127. https://doi.org/10.1016/j.infsof.2020.106366
Yáñez Gómez, R., Cascado Caballero, D., & Sevillano, J.-L. (2014). Heuristic Evaluation on Mobile Interfaces: A New Checklist. The Scientific World Journal, 434326. https://doi.org/10.1155/2014/434326








