Assessment of Students’ Cognitive–affective States in Learning Within a Computer-Based Environment: Effects on Performance

Authors

  • Ruili Wang School of Engineering and Advanced Technology (SEAT), Massey University Auckland, New Zealand
  • Hokyoung Ryu Department of Industrial Engineering, Hanyang University Seoul, Korea, Republic of
  • Norliza Katuk School of Computing, Universiti Utara Malaysia, Malaysia

DOI:

https://doi.org/10.32890/jict2015.14.9

Keywords:

Computer-based learning, cognitive-affective states, learning engagement, learning experience

Abstract

Students’ cognitive-affective states are human-elements that are crucial in the design of computer-based learning (CBL) systems. This paper presents an investigation of students’ cognitiveaffective states (i.e., engaged concentration, anxiety, and boredom) when they learn a particular course within CBL systems. The results of past studies by other researchers suggested that certain cognitive-affective states; particularly boredom and anxiety could negatively infl uence learning in a computer-based environment. This paper investigates the types of cognitive-affective state that students experience when they learn through a specifi c instance of CBL (i.e., a content sequencing system). Further, research was carried to understand whether the cognitive-affective states would infl uence students’ performance within the environment. A one-way between-subject-design experiment was conducted utilizing four instruments (i) CBL systems known as IT-Tutor for learning computer network, (ii) a pre-test, (iii) a post-test, and (iv) self-report inventory to capture the students’ cognitive-affective states. A cluster analysis and discriminant function analysis were employed to identify and classify the students’ cognitiveaffective states. Students were classifi ed according to their prior knowledge to element the effects of it on performance. Then, non-parametric statistical tests were conducted on different pairs of cluster of the cognitive-affective states and prior knowledge to determine differences on students’ performance. The results of this study suggested that all the three cognitive-affective states were experienced by the students. The cognitive-affective states were found to have positive effects on the students’ performance. This study revealed that disengaged cognitive-affective states, particularly boredom can improve learning performance for lowprior knowledge students.

 

References

Aart, J. V., Bartneck, C., Hu, J., Rauterberg, M., & Salem, B. (2010). How to behave as Alice in Wonderland–about boredom and curiosity. Entertainment Computing, 1(3), 125-137.

Amadieu, F., Tricot, A., & Mariné, C. (2009). Prior knowledge in learning from a non-linear electronic document: Disorientation and coherence of the reading sequences. Computers in Human Behavior, 25(2), 381-388.

Baker, R. S., D’Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010). Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies, 68(4), 223-241.

Barreto, A., Zhai, J., & Adjouadi, M. (2007). Non-intrusive physiological monitoring for automated stress detection in human-computer interaction. In Human–Computer Interaction (29-38). Springer Berlin Heidelberg.

Bennet, A., & Bennet, D. (2008). E-Learning as energetic learning. VINE, 38(2), 206-220.

Calisir, F., Eryazici, M., & Lehto, M. R. (2008). The effects of text structure and prior knowledge of the learner on computer-based learning. Computers in Human Behavior, 24(2), 439-450.

Chan, D. (2008). So why ask me? are self-report data really that bad? in C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological Myths and urban legends: Doctrine, verity and fable in organizational and social sciences (309). New York: Routledge.

Corder, G. W., & Foremen, D. I. (2009). Nonparametric statistics for non-statisticians: A step-by-step approach. New Jessey: John Wiey & Sons.

Csikszentmihalyi, M. (1975). Beyond boredom and anxiety: Experiencing flow in work and play San Francisco: Jossey-Bass.

Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. New York: Harper & Row Publishers.

D’Mello, S. K., Craig, S. D., & Graesser, A. C. (2009). Multi-method assessment of affective experience and expression during deep learning. International Journal of Learning Technology, 4(3/4), 165-187.

Forbes-Riley, K., & Litman, D. (2011). When does disengagement correlate with learning in spoken dialog computer tutoring? Artificial Intelligence in Education. In G. Biswas, S. Bull, J. Kay & A. Mitrovic (Eds.), 6738, 81-89: Springer Berlin: Heidelberg.

Gascueña, J. M., & Fernández-Caballero, A. (2005). An agent-based intelligent tutoring system for enhancing e-learning/e-teaching. International Journal of Instructional Technology and Distance Learning, 2(11), 11-24. Journal of ICT, 14, 2015, pp: 153–

Greene, J. A., Costa, L.-J., Robertson, J., Pan, Y., & Deekens, V. M. (2010). Exploring relations among college students’ prior knowledge, implicit theories of intelligence, and self-regulated learning in a hypermedia environment. Computers & Education, 55(3), 1027-1043.

Gutierrez, S., Pardo, A., & Kloos, C. (2004). Beyond simple sequencing: Sequencing of learning activities using hierarchical graphs Proceedings of AISTED International Conference on Web-Based Education 2004, 514-519. Austria.

Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1995). Multivariate data analysis (4th ed.): With readings. New Jersey: Prentice-Hall, Inc.

Hill, T., & Lewicki, P. (2006). Statistics: Methods and applications : A comprehensive reference for science, industry, and data mining. New York: StatSoft, Inc.

Husni, H., Jamaludin, Z., & Aziz, F. A. (2013). Dyslexic children’s reading application: Design for affection. Journal of Information & Communication Technology, 12, 1-19.

Johnson, R. D., Hornik, S., & Salas, E. (2008). An empirical examination of factors contributing to the creation of successful e-learning environments. International Journal of Human-Computer Studies, 66(5), 356-369.

Jung, J. W., & Park, I. W. (2004). The effects of information modality and learner’s prior knowledge on the achievement of the web-based learning. In L. Cantoni & C. McLoughlin (Eds.), World Conference on Educational Multimedia, Hypermedia and Telecommunications 2004 (1823-1828). Lugano, Switzerland: AACE.

Kalyuga, S. (2005). Prior knowledge principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (325-357). New York: Cambridge University Press.

Kalyuga, S. (2011). Cognitive load theory: Implications for affective computing. Paper presented at the FLAIRS Conference.

Katuk, N. (2012). Learning experience in dynamic and non-dynamic curriculum sequencing systems: A thesis presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Information Technology at Massey University.

Katuk, N. (2013). Progressive assessment of student engagement with web-based guided learning. Interactive Technology and Smart Education, 10(2), 116-129.

Katuk, N., Kim, J., & Ryu, H. (2013). Experience beyond knowledge: Pragmatic e-learning systems design with learning experience. Computers in Human Behavior, 29(3), 747-758. Journal of ICT, 14, 2015, pp: 153–

Khan, F. A., Weippl, E. R., & Tjoa, A. M. (2009). Integrated Approach for the detection of learning styles and affective states. In World Conference on Educational Multimedia, Hypermedia and Telecommunications 2009, (1), 753-761.

Kim, C., & Pekrun, R. (2014). Emotions and motivation in learning and performance. Handbook of research on educational communications and technology (65-75): Springer

Klein, J., Moon, Y., & Picard, R. W. (2002). This computer responds to user frustration: Theory, design, and results. Interacting with Computers, 14(2), 119-140.

Kolakowska, A., Landowska, A., Szwoch, M., Szwoch, W., & Wrobel, M. R. (2013, June). Emotion recognition and its application in software engineering. In proceedings of the 6th International Conference on Human System Interaction (HSI), 2013 (532-539). IEEE.

Kopcha, T., & Sullivan, H. (2008). Learner preferences and prior knowledge in learner-controlled computer-based instruction. Educational Technology Research and Development, 56(3), 265-286.

Korobili, S., Togia, A., & Malliari, A. (2010). Computer anxiety and attitudes among undergraduate students in Greece. Computers in Human Behavior, 26(3), 399-405.

Kvam, P. H., & Vidakovic, B. (2007). Nonparametric statistics with applications to science and engineering. New Jersey: John Wiley & Sons.

Lehman, B., Matthews, M., D’Mello, S., & Person, N. (2008). What are you feeling? Investigating student affective states during expert human tutoring sessions. In Intelligent Tutoring Systems (50-59). Springer Berlin Heidelberg.

Linnenbrink-Garcia, L., & Pekrun, R. (2011). Students’ emotions and academic engagement: Introduction to the special issue. Contemporary Educational Psychology, 36(1), 1-3.

Maïano, C., Therme, P., & Mestre, D. (2011). Affective, anxiety and behavioral effects of an aversive stimulation during a simulated navigation task within a virtual environment: A pilot study. Computers in Human Behavior, 27(1), 169-175.

Mann, S., & Robinson, A. (2009). Boredom in the lecture theatre: An investigation into the contributors, moderators and outcomes of boredom amongst university students. British Educational Research Journal, 35(2), 243-258.

Mitchell, T. J. F., Chen, S. Y., & Macredie, R. D. (2005). Hypermedia learning and prior knowledge: Domain expertise vs. system expertise. Journal of Computer Assisted Learning, 21(1), 53-64. Journal of ICT, 14, 2015, pp: 153–

Park, J., Parsons, D., & Ryu, H. (2010). To flow and not to freeze: Applying flow experience to mobile learning. IEEE Transactions on Learning Technologies, 3(1), 56-67.

Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91-105.

Pekrun, R., Goetz, T., Daniels, L. M., Stupnisky, R. H., & Perry, R. P. (2010). Boredom in achievement settings: Exploring control–value antecedents and performance outcomes of a neglected emotion. Journal of Educational Psychology, 102(3), 531-549.

Picard, R. W. (2003). Affective computing: challenges. International Journal of Human-Computer Studies, 59(1), 55-64.

Raphael, C., Bachen, C. M., & Hernández-Ramos, P. F. (2012). Flow and cooperative learning in civic game play. New Media & Society, 14(8), 1321-1338.

Rogers, K. B., & Robinson, D. T. (2014). Measuring Affect and Emotions. Handbook of the Sociology of Emotions: Volume II (283-303): Springer:

Ronan, G. F., Dreer, L., Maurelli, K., Ronan, D. W., & Gerhart, J. (2014). Measures of Anger Practitioner’s Guide to Empirically Supported measures of anger, aggression, and violence (19-86). springer.

Ryu, H., & Parsons, D. (2012). Risky business or sharing the load? Social flow in collaborative mobile learning. Computers & Education, 58(2), 707-720.

Schall, A. (2014). New methods for measuring emotional engagement design, user experience, and usability. User experience design practice (347-357): Springer.

Shen, L., Wang, M., & Shen, R. (2009). Affective e-Learning: Using emotional data to improve learning in pervasive learning environment. Educational Technology & Society, 12(2), 176-189.

Sheskin, D. J. (2003). Handbook of parametric and nonparametric statistical procedures. Florida: CRC Press.

Shin, E. J., Schallert, D., & Savenye, W. C. (1994). Effects of learner control, advisement & prior knowledge on young students’ learning in a hypertext environment. Educational Technology Research and Development, 42(1), 33-46.

Terzis, V., Moridis, C. N., & Economides, A. A. (2012). The effect of emotional feedback on behavioral intention to use computer based assessment. Computers & Education, 59(2), 710-721.

Ulbricht, V. N. R., Berg, C. H., Fadel, L., & Quevedo, S. R. (2014). The emotion Component on usability testing human computer interface of Journal of ICT, 14, 2015, pp: 153– an Inclusive learning management system learning and collaboration technologies. Designing and developing novel learning experiences (334-345): Springer.

Vogel-Walcutt, J., Fiorella, L., Carper, T., & Schatz, S. (2011). The definition, assessment, and mitigation of state boredom within educational settings: a comprehensive review. Educational Psychology Review, 24(1), 89-111.

Webster, J., Trevino, L. K., & Ryan, L. (1993). The dimensionality and correlates of flow in human-computer interactions. Computers in Human Behavior, 9(4), 411-426.

Zembylas, M. (2008). Adult learners’ emotions in online learning. Distance Education, 29(1), 71-87.

Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009). A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1), 39-58.

Zhang, L., & Zhang, B. (2006). Quotient Space Based Cluster Analysis. In T. Y. Lin, S. Ohsuga, C. J. Liau & X. Hu (Eds.), Foundations and novel approaches in data mining (259-270). Heidelberg: Springer.

Downloads

Published

28-04-2015

Issue

Vol. 14 (2015): Journal of Information and Communication Technology (JICT) Vol. 14, 2015

Section

Articles

How to Cite

Wang, R., Ryu, H., & Katuk, N. (2015). Assessment of Students’ Cognitive–affective States in Learning Within a Computer-Based Environment: Effects on Performance. Journal of Information and Communication Technology, 14, 153-176. https://doi.org/10.32890/jict2015.14.9

Research impact

Harvested 2026-09-06
7 citations, from OpenAlex — the highest of the sources checked

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2015.14.9 OpenAlex W4244026193 Scopus 85182127563

Most read articles by the same author(s)