Analysis of User Requirements for a Mobile Augmented Reality Application to Support Literacy Development Amongst Hearing-Impaired Children

Authors

  • Shiroq Al-Megren Information Technology Department, King Saud University, Saudi Arabia
  • Aziza Almutairi Information Technology Department, King Saud University, Saudi Arabia

DOI:

https://doi.org/10.32890/jict2019.18.1.6

Keywords:

Arabic sign language, augmented reality, hearing impaired, deaf reading, deaf education

Abstract

Literacy is fundamental for children’s growth and development, as it impacts their educational, societal, and vocational progress. However, the mapping of language to printed text is different for children with hearing impairments. When reading, a hearing-impaired child maps text to sign language (SL) which is a visual language that can benefit from technological advancements, such as augmented reality (AR). There exist several efforts that utilise AR for the purpose of advancing the educational needs of people who are hearing impaired for different SLs. Nevertheless, only a few directly elicit the visual needs of children who are hearing impaired. This study aims to address this gap in the literature with a series of user studies to elicit user requirements for the development of an AR application that supports the literacy development of Arab children who are hearing impaired. Three instruments were utilised in these user studies, each targeting a different group of literacy influencers: questionnaires issued to parents of children with hearing impairments, interviews with teachers, and observations of children who were deaf or hard of hearing. The findings indicated that the parents and teachers preferred Arabic SL (ArSL), pictures, and videos, whereas the children struggled with ArSL and preferred finger-spelling. These preferences highlighted the importance of integrating various resources to strengthen the written Arabic and ArSL literacy of Arab children. The findings have contributed to the literature on the preferences of Arab children who are hearing impaired, their educators, and parents. They also showed the importance of establishing requirements elicited directly from intended users who are disabled to proactively support their learning process. The results of the study were used in the preliminary development of Word & Sign, an AR mobile application intended to aid Arab children who are hearing impaired in their linguistic development.

 

References

Ahmed, N. Nahar F., & Haqul, A. M. (2017) Freephony: Minimalistic Interface developed for t visually impaired and the elderly community in Bangladesh. Jounal of Information and Communication Technology, 16(1), 175-191.

Al-Nafjan, A., Al-Arifi, B., & Al-Wabil, A. (2015). Design and development of an educational Arabic sign language mobile application: Collective impact with Tawasol. Proceedings of the International Conference on Universal Access in Human-Computer Interaction (pp. 319–326). https://doi.org/10.1007/978-3-319-20681-3_30

Alnafjan, A., Aljumaah, A., Alaskar, H., & Alshraihi, R. (2017). Designing “Najeeb”: Technology-enhanced learning for children with impaired hearing using Arabic sign-language ArSL Applications. Proceedings of the 2017 International Conference on Computer and Applications (pp. 238–273). IEEE. https://doi.org/10.1109/COMAPP.2017.8079772 Journal of ICT, 18, No. 1 (January) 2019, pp: 97–

Alyami, H., Soer, M., Swanepoel, A., & Pottas, L. (2016). Deaf or hard of hearing children in Saudi Arabia: Status of early intervention services. International Journal of Pediatric Otorhinolaryngology, 86, 142–149. https://doi.org/10.1016/j.ijporl.2016.04.010

Baby Sign and Learn. Magic Camera - American Sign Language Edition. (2018). Retrieved from https://itunes.apple.com/us/app/magic-camera-american-sign-language-edition/id662781080?mt=8

Barma, S., Daniel, S., Bacon, N., Gingras, M.-A., & Fortin, M. (2015). Observation and analysis of a classroom teaching and learning practice based on augmented reality and serious games on mobile platforms. International Journal of Serious Games, 2(2), 69–88. https://doi.org/10.17083/ijsg.v2i2.66

Billinghurst, M., & Dünser, A. (2012). Augmented reality in the classroom. Computer, 45(7), 56–63. https://doi.org/10.1109/MC.2012.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Using Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/The publisher’s URL is: http://dx.doi.org/10.1191/1478088706qp063oa

Cadenanes, J., & Arrieta, A. G. (2014). Development of sign language communication skill on children through augmented reality and the MuCy model. Proceedings of Methodologies and Intelligent Systems for Technology Enhanced Learning (pp. 45–52). https://doi.org/10.1007/978-3-319-07698-0_6

Correa, A. G. D., Tahira, A., & Ribeir, J. B. (2012). Development of an Interactive Book with Augmented Reality for Teaching and Learning Geometric Shapes. Proceedings of the 7th Iberian Conference on Information Systems and Technologies (pp. 1–6).

Craig, A. B., & Craig, A. B. (2013). Mobile augmented reality. In Understanding Augmented Reality: Concepts and applications (pp. 209–220). Newness. https://doi.org/10.1016/B978-0-240-82408-6.00007-2

DAQRI. Anatomy 4D. (2018). Retrieved from http://anatomy4d.daqri.com/

Diegmann, P., Schmidt-Kraepelin, M., Van den Eynden, S., Basten, D., Eynden, S. Van Den, & Basten, D. (2015). Benefits of augmented reality in educational environments – A systematic literature review. Wirtschaftsinformatik, 3(6), 1542–1556.

Dunleavy, M., Dede, C., & Mitchell, R. (2009). Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of Science Education and Technology, 18(1), 7–22. https://doi.org/10.1007/s10956-008-9119-1

Dünser, A., Grasset, R., & Billinghurst, M. (2008). A survey of evaluation techniques used in augmented reality studies. New Zealand: Human Interface Technology Laboratory. https://doi.org/10.1145/1508044.1508049 Journal of ICT, 18, No. 1 (January) 2019, pp: 97–

Elkins, J. (2008). The concept of visual literacy, and its limitations. In Visual Literacy (pp. 1–9). Routledge. https://doi.org/10.4324/9780203939574

Garrett, B. M., Jackson, C., & Wilson, B. (2015). Augmented reality m-learning to enhance nursing skills acquisition in the clinical skills laboratory. Interactive Technology and Smart Education, 12(4), 298–314. https://doi.org/10.1108/ITSE-05-2015-0013

Geeslin, J. D. (2008). Deaf bilingual education: A comparison of the academic performance of deaf children of deaf parents and deaf children of hearing parents. Bloomington, Indiana: Indiana University.

Georgiou, Y., & Kyza, E. A. (2017). The development and validation of the ARI questionnaire: An instrument for measuring immersion in location-based augmented reality settings. International Journal of Human Computer Studies, 98, 24–37. https://doi.org/10.1016/j.ijhcs.2016.09.014

Goldin-Meadow, S., Mayberry, R. I., & Read, T. O. (2001). How do profoundly deaf children learn to read? Learning Disabilities Research & Practice, 16(4), 222–229. https://doi.org/10.1111/0938-8982.00022

Hanson, V. L. (1989). Phonology and reading : Evidence from profoundly deaf readers. In Phonology and Reading Disability: Solving the Reading Puzzle (pp. 67–89). Ann Arbor, Michigan: University of Michigan Press.

Humphries, T., & MacDougall, F. (1999). Chaining and other links: Making connections between American Sign Language and English in Two types of school settings. Visual Anthropology Review, 15(2), 84–94. https://doi.org/10.1525/var.2000.15.2.84

Kids App. Let’s Read. (2017). Retrieved from https://itunes.apple.com/us/ app// id1205247520?mt=8 Kingdom of Saudi Arabia General Authority of Statistics. Demographic survey. (2017). Retrieved from https://www.stats.gov.sa/en/852

Kožuh, I., Hauptman, S., Kosec, P., & Debevc, M. (2015). Assessing the efficiency of using augmented reality for learning sign language. Proceedings of the International Conference on Universal Access in Human-Computer Interaction (pp. 404–415). https://doi.org/10.1007/978-3-319-20681-3_38

McIntosh, M. J., & Morse, J. M. (2015). Situating and constructing diversity in semi-structured interviews. Global Qualitative Nursing Research, 2, 1–12. https://doi.org/10.1177/ 2333393615597674

Mellon, N. K., Niparko, J. K., Rathmann, C., Mathur, G., Humphries, T., Jo Napoli, D., … Lantos, J. D. (2015). Should all deaf children learn sign language? Pediatrics, 136(1), 170–176. https://doi.org/10.1542/ peds.2014-1632 mHealth Company. Hayaak. (2018). Retrieved from https://itunes.apple.com/ gb/app/ hayaak/id1152564831?mt=8 Journal of ICT, 18, No. 1 (January) 2019, pp: 97–

Mich, O. (2009). Evaluation of software tools with deaf children. Proceeding of the Eleventh International ACM SIGACCESS Conference on Computers and Accessibility (pp. 235-236). https://doi.org/10.1145/1639642.1639692

Mind Rockets Inc. Alturjuman. (2018). Retrieved from https://play.google. com/store/ apps/details?id=com.mindrockets.turjoman&hl=ar

Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1–13. https://doi.org/10.1177/1609406917733847

O’Shea, P. M., Dede, C., & Cherian, M. (2011). The results of formatively evaluating an agugmented reality curriculum based on modified design principles. International Journal of Gaming and Computer-Mediated Simulations, 3(2), 57–66. https://doi.org/10.4018/ jgcms.2011040104

Oka Sudana, A. A. K., Aristamy, I. G. A. A. M., & Wirdiani, N. K. A. (2016). Augmented reality application of sign language for deaf people in Android based on smartphone. International Journal of Software Engineering and Its Applications, 10(8), 139–150. https://doi.org/10.14257/ijseia.2016.10.8.13

Pinto, D., Mosquera, J., Gonzalez, C., Tobar-Muñoz, H., Baldiris, S., & Fabregat, R. (2017). Augmented reality board game for supporting learning and motivation in an indigenous community. Proceedings of the V International Congress on Videogames & Education (pp. 213–222).

Samuel, R. J., & Zaitun, A. B. (2007). Do teachers have adequate ICT resources and the right ICT skills in integrating ICT tools in the teaching and learning of English language in Malaysian schools? The Electronic Journal of Information Systems in Developing Countries, 29(1), 1–15. https://doi.org/10.1002/j.1681-4835.2007.tb00196.x

Sungkur, R. K., Panchoo, A., & Bhoyroo, N. K. (2016). Augmented reality, the future of contextual mobile learning. Interactive Technology and Smart Education, 13(2), 123–146. https://doi.org/10.1108/ITSE-07-2015-0017

Treiman, R., & Hirsh-Pasek, K. (1983). Silent reading: Insights from second-generation deaf readers. Cognitive Psychology, 15(1), 39–65. https://doi.org/10.1016/0010-0285(83)90003-8

Turner, D. W. (2010). Qualitative interview design: A practical guide for novice investigators. The Qualitative Report, 15(3), 754–760. https://doi.org/http://www.nova.edu/ssss/QR/QR15-3/qid.pdf

Uluyol, Ç., & Sahin, S. (2016). Augmented reality: A new direction in education. In Emerging Tools and Applications of Virtual Reality in Education (pp. 239–257). IGI Global. https://doi.org/10.4018/978-1-4666-9837-6.ch011 Journal of ICT, 18, No. 1 (January) 2019, pp: 97–

Wojciechowski, R., & Cellary, W. (2013). Evaluation of learners’ attitude toward learning in ARIES augmented reality environments. Computers and Education, 68, 570–585. https://doi.org/10.1016/j. compedu.2013.02.014

Xu, Y., Spasojevic, M., Gao, J., & Jacob, M. (2008). Designing a vision-based mobile interface for in-store shopping. Proceedings of the 5th Nordic conference on Human-computer interaction (pp. 393–402). https://doi.org/10.1145/1463160.1463203

Yilmaz, R. M. (2016). Educational magic toys developed with augmented reality technology for early childhood education. Computers in Human Behavior, 54, 240–248. https://doi.org/10.1016/ j.chb.2015.07.040

Zainuddin, N. M. M., Zaman, H. B., & Ahmad, A. (2009). Learning science using AR book: A preliminary study on visual needs of deaf learners. Proceedings of the International Visual Informatics Conference (pp. 844–855). https://doi.org/10.1007/978-3-642-05036-7_80

Zainuddin, N. M. M., Zaman, H. B., & Ahmad, A. (2011). Heuristic evaluation on Augmented Reality courseware for the deaf. Proceedings of the International Conference on User Science and Engineering (pp. 183–188). https://doi.org/10.1109/iUSEr.2011.6150562

Zhu, E., Hadadgar, A., Masiello, I., & Zary, N. (2014). Augmented reality in healthcare education: An integrative review. PeerJ, 2, e469. https://doi.org/10.7717/peerj.469

Downloads

Published

11-12-2018

Issue

Vol. 18 No. 1 (2019): Journal of Information and Communication Technology (JICT) Vol.18, No.1, January 2019

Section

Articles

How to Cite

Al-Megren, S., & Almutairi, A. (2018). Analysis of User Requirements for a Mobile Augmented Reality Application to Support Literacy Development Amongst Hearing-Impaired Children. Journal of Information and Communication Technology, 18(1), 97-121. https://doi.org/10.32890/jict2019.18.1.6

Research impact

Harvested 2026-09-26
6 citations, from OpenAlex — the highest of the sources checked

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2019.18.1.6 OpenAlex W4235440013