A Metric-Based Evaluation Model for Applications on Mobile Phones

Authors

  • Azham Hussain School of Computing, UUM College of Arts and Sciences, Universiti Utara Malaysia 06010 Sintok, Kedah, Malaysia
  • Nor Laily Hashim School of Computing, UUM College of Arts and Sciences, Universiti Utara Malaysia 06010 Sintok, Kedah, Malaysia
  • Nazib Nordin School of Computing, UUM College of Arts and Sciences, Universiti Utara Malaysia 06010 Sintok, Kedah, Malaysia
  • Hatim Mohamad Tahir School of Computing, UUM College of Arts and Sciences, Universiti Utara Malaysia 06010 Sintok, Kedah, Malaysia

DOI:

https://doi.org/10.32890/jict2013.12.4

Keywords:

Usability, goal question metric, mobile application, iPhone, O2 orbit

Abstract

A number of methods and measures have been used by researchers in software evaluation. Usability metrics is one of the approaches that has been used as a guideline to evaluate the quality of the system in many mobile applications. However, the metrics used for evaluation method keep changing due to new inventions of mobile phones. Thus, there is a need to create a dynamic model for evaluation that can grow together with new inventions and technology. In this paper, a dynamic usability metrics model for evaluation of mobile applications was designed. The model comprises usability goals, questions and metrics for evaluation of applications on mobile phones. To ensure that the model is reliable and effective, a usability study was conducted on two applications installed in different mobile phones. This model proves to be applicable for evaluation of mobile phone applications whereby its questions and metrics can be dynamically changed accordingly to comply with the requirements of the evaluators.

 

References

Ahmed, S., Mohammad, D., Rex, B., & Harkirat, K. (2006). Usability measurement and metrics: A consolidated model. Software Quality Control, 14(2), 159-178. Ali Kattan, Rosni Abdullah, Rosalina Abdul Salam, & Sureswaran Ramedas. (2009). Building distributed heterogeneous smart phone Java applications an evaluation from a development perspective. Journal of Information and Communication Technology, 8, 67-83. Journal of ICT, 12, 2013, pp: 55–

Baillie, L. (2003). Future telecommunication: Exploring actual use. Paper presented at the International Conference on Human-Computer Interaction, (INTERACT ´03).

Basili, V., Caldeira, G., & Rombach, H. (1994). The goal question metric approach. Encyclopedia of Software Engineering. http://jict.uum.edu.my/

Benbasat, I. (2010). HCI research: Future challenges and directions. AIS Transactions on Human-Computer Interaction, 2(2), 16-21.

Bertoa, M. F. T., & Vallecillo. (2006). Measuring the usability of software components. Journal of Systems and Software, 79(3), 427-439.

Constantinos, K. C., & Dan, K. (2007). A research agenda for mobile usability. Paper presented at the CHI ‘07 Extended Abstracts on Human Factors in Computing Systems.

Fabio, B., Luca, C., Elio, C., & Marco, C. (2010). Using mobile devices to support communication between emergency medical responders and deaf people. Paper presented at the 12th International Conference on Human Computer Interaction with Mobile Devices and Services.

Gafni, R. (2008). Framework for quality metrics in mobile-wireless information systems. Interdisciplinary Journal of Information, Knowledge and Management, 3, 23-38.

Gafni, R. (2009). Usability Issues in mobile-wireless information systems. Issues in Informing Science and Information Technology, 6, 755-769.

Henry, D., Vivian, H., & Chee, B. T. (2008). Playing different games on different phones: An empirical study on mobile gaming. Paper presented at the 10th International Conference on Human Computer Interaction with Mobile Devices and Services.

Hornbæk, K. (2006). Current practice in measuring usability: Challenges to usability studies and research. International Journal of Human-Computer Studies, 64(2), 79-102.

Hornbæk, K., & Law, E. L.C. (2007). Meta-analysis of correlations among usability measures. Paper the SIGCHI Conference on Human Factors in Computing Systems. Journal of ICT, 12, 2013, pp: 55–

ISO. (1998). INTERNATIONAL STANDARD: ISO 9241-11(Guidance on usability). Geneva.

Jin, B. S., & Ji, Y. G. (2010). Usability risk level evaluation for physical user interface of mobile phone. Computers in Industry, 61 (May), 350-363. http://jict.uum.edu.my/

Jun, G., & Tarasewich, P. (2004). Guidelines for handheld mobile device interface design. Paper presented at DSI 2004 Annual Meeting, Boston.

Kjeldskov, J., & Stage, J. (2004). New techniques for usability evaluation of mobile systems. International Journal of Human-Computer Studies, 60(5-6), 599-620.

Kondratova, I., & Goldfarb, I. (2006). M-learning: Overcoming the usability challenges of mobile devices. Paper presented at the Networking, International Conference on Systems and International Conference on Mobile Communications and Learning Technologies, 2006. ICN/ ICONS/MCL.

Luca, C., & Alessandro, M. (2010). Supporting blind users in selecting from very long lists of items on mobile phones. Paper presented at the 12th International Conference on Human Computer Interaction with Mobile Devices and Services.

Lyytinen, K. (2010). Human-computer interaction research: Future directions that matter. AIS Transactions on Human-Computer Interaction, 2(2), 22-25.

Marco, S., & Luis, D. (2008). Defining scenarios for mobile design and evaluation. Paper presented at the CHI ‘08 Extended Abstracts on Human Factors in Computing Systems.

Marco, S., Luis, C., & Tiago, R. (2008). A framework for mobile evaluation. Paper presented at the CHI ‘08 extended abstracts on Human factors in computing systems.

Nielsen, J. (1994). Usability engineering. London: Morgan Kaufmann.

Pirhonen, A., Stephen, B., & Christopher, H. (2002). Gestural and audio metaphors as a means of control for mobile devices. Paper presented at the SIGCHI Conference on Human Factors in Computing Systems: Changing Our World, Changing Ourselves. Journal of ICT, 12, 2013, pp: 55–

Rita, H. (2006). Accessibility and usability guidelines for mobile devices in home health monitoring. ACM SIGACCESS Accessibility and Computing, (84), 26-29.

Rudy, S., Carolyn, W., & Mark, L. (2007). Towards the perfect infrastructure for usability testing on mobile devices. Paper presented at the CHI ‘07 http://jict.uum.edu.my/ Extended Abstracts on Human factors in Computing Systems.

Scholtz, J. (2004). Usability evaluation. Retrieved from http://www.itl.nist. gov/iad/IADpapers/2004/Usability%20Evaluation_rev1.pdf

Shneiderman, B. (1998). Designing the user interface: Strategies for effective human-computer interaction (3rd ed.). Michigan: Addison-Wesley Longman Publishing.

Tiago, J., Hugo, G., Joaquim, J., & Daniel, G. (2010). Assessing mobile touch interfaces for tetraplegics. Paper presented at the 12th International Conference on Human Computer Interaction with Mobile Devices and Services.

Zhang, D., & Adipat, B. (2005). Challenges, methodologies, and issues in the usability testing of mobile applications. International Journal of Human-Computer Interaction, 18(3), 293-308.

Downloads

Published

23-04-2013

Issue

Vol. 12 (2013): Journal of Information and Communication Technology (JICT) Vol. 12, 2013

Section

Articles

How to Cite

Hussain, A., Hashim, N. L., Nordin, N., & Mohamad Tahir, H. (2013). A Metric-Based Evaluation Model for Applications on Mobile Phones. Journal of Information and Communication Technology, 12, 55-71. https://doi.org/10.32890/jict2013.12.4

Research impact

Harvested 2026-09-06
0 citations recorded so far

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2013.12.4

Most read articles by the same author(s)