THE DICHOTOMIZATION OF OBJECTIVE AND SUBJECTIVE OUTCOME MEASURES OF ACADEMIC PERFORMANCE IN AN ONLINE LEARNING ENVIRONMENT

Authors

  • Parmjit Singh a/l Aperapar Singh Faculty of Education, Universiti Teknologi MARA, Selangor, Malaysia
  • Lilian Anthonysamy Faculty of Management, Multimedia University, Selangor, Malaysia

DOI:

https://doi.org/10.32890/mjli2023.20.1.3

Keywords:

Online learning, objective measures, subjective measures, perception, CGPA, perceived academic performance

Abstract

Purpose – Various recent studies are perplexed with the situation if subjective measures such as perceptions of learning reflect knowledge gains and whether they can be used as a surrogate for evidence of actual learning in an online learning environment. Due to a rising trend in current research studies interpreting perceptions of learning compared to actual learning as a measure of success, this study investigates the dichotomous measures of objective and subjective measures of academic performance in an online learning environment with selected predicted variables. This is followed by an investigation on the effect of online learning on students’ academic performance prior to and during the Covid environment.

Methodology – This cross-sectional study employed a correlation design for the purpose of data collection among 382 university
students. The dependent variable of study comprised objective measures of CGPA scores while the subjective measures was based
on a composite score from perceived items in a questionnaire. The predictive independent variables included, i) satisfaction towards
online learning, ii) online learning self-efficacy, iii) social interactive engagement in online learning, and iv) online learning environment.

Findings – The findings showed an extremely weak and nonsignificant relationship between actual academic performance
(GPA) and perceived academic performance in an online learning environment. A statistically significant increase was notable in
students’ academic performance through GPA scores before and during Covid-19 academic semester and this increase was prevalent
among low and intermediate achievers. Apart from environment, all other predictors were significant predictors of perceived academic performance. Engagement was a predictor for the subjective measure of CGPA scores.

Significance – Subjective measures data should not be considered as knowledge gain, and it should be used cautiously as a surrogate
for evidence of actual learning. Educational research studies should be designed using more objective measures of learning rather
than subjective measures in isolation as dependent variable. This should be seen as a caveat by policymakers in decision-making to
practise consciousness in terms of judgemental modes employed in measurement and to exercise caution in collecting, analysing, and
interpreting subjective data. 

Metrics

Metrics Loading ...

References

Abramenka, Vladimir (2015). Students’ Motivations and Barriers to Online Education (Unpublished master’s thesis). Grand Valley State University. https://scholarworks.gvsu.edu/cgi/viewcontent.cgi?article=1775&context=theses

Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological Review, 84(2), 191-215. https://doi.org/10.1037/0033-295X.84.2.191

Banna, J., Lin, M.-F. G., Stewart, M., & Fialkowski, M. K. (2015). Interaction matters: Strategies to promote engaged learning in an online introductory nutrition course. Journal of Online Learning and Teaching, 11(2), 249–261.

Bettinger, E., Fox, L., Loeb, S., & Taylor, E. (2015). Changing Distributions: How Online College Classes Alter Student and Professor Performance (CEPA Working Paper No.15-10). Stanford Center for Education Policy Analysis. http://cepa.stanford.edu/wp15-10

Britt, M. (2015). How to better engage online students with online strategies. College Student Journal, 49(3), 399–404.

Cavanaugh, J. K., Jacquemin, S. J. (2015). A large sample comparison of grade based student learning outcomes in online vs. face-to-face courses. Online Learning, 19(2), 1-8. https://doi.org/10.24059/olj.v19i2.454

Chapanis, A. (1959). Research techniques in human engineering. Baltimore, MD: Johns Hopkins University Press.

Cole, K. C. (1985, September). Is there such a thing as scientific objectivity? Discover, pp. 98-99.

Deslauriers, L., L. McCarty, K. Miller, K. Callaghan, and G. Kestin. 2019. “Measuring Actual Learning versus Feeling of Learning in Response to Being Actively Engaged in the Classroom.” Proceedings of the National Academy of Sciences of the United States of America 116 (39), 19251–19257. https://doi.org/10.1073/pnas.1821936116

Dixson, M. D. (2010). Creating effective student engagement in online courses: What do students find engaging? Journal of the Scholarship of Teaching and Learning, 10(2), 1– 13.

Dogan, U. (2015). Student engagement, academic self-efficacy, and academic motivation as predictors of academic performance. The Anthropologist, 20(3), 553-561. https://doi.org/10.1080/09720073.2015. 11891759

Dunlosky, J., & Rawson, K. A. (2012). Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention. Learning and Instruction, 22(4), 271–280. https://doi.org/10.1016/j.learninstruc.2011.08.003

Eastin, M.S. & LaRose, R. (2000). Internet Self-Efficacy and the Psychology of the Digital Divide. Journal of Computer-Mediated Communication, 6(1). https://doi.org/10.1111/j.1083-6101.2000.tb00110.x

Eric, B. and Susanna, L. (2017). Promises and pitfalls of online education. Evidence Speaks Reports, 2(15), 1- 4.

Gallagher, S. (2021). How to Help High-Achieving Students Manage Stress? https://teach.com/resources/high-achieving-students-manage-stress/

Gillett-Swan, J. (2017). The Challenges of Online Learning Supporting and Engaging the Isolated Learner. Journal of Learning Design, 10(1), 20-30. doi:10.5204/jld.v9i3.293

Hajar, Mohd. Nor (2015). Conditions facilitating the Implementation of Information and Communication Technology (ICT) Integration in the Malaysia Smart School (Unpublished PHD thesis). Universiti Putra Malaysia, Serdang, Selangor. http://psasir.upm.edu.my/id/eprint/6548/

Hung, M. L., Chou, C., Chen, C. H., & Own, Z. Y. (2010). Learner readiness for online learning: Scale development and student perceptions. Computers & Education, 55(3), 1080–1090. https://doi. org/10.1016/j.compedu.2010.05.004

Jackon, L. C., Jones, S. J., & Rodriguez, R. C. (2010). Faculty actions that result in student satisfaction in online courses. Journal of Asynchronous Learning Networks, 14(4), 78-96. doi:10.24059/OLJ.V14I4.129

Januzewski, A., and Molenda, M. (Eds.) (2007). Educational technology: A definition with commentary. Definition and Terminology Committee of the Association for Educational Communications and Technology. P 1-14, New York, NY: Routledge.

Jessica B. H., Nicholas, S., Elaine, A., Kirk, W., Jordan, R., Suzanne, S. T. & Valerie, M. (2017). The Struggle to Pass Algebra: Online vs. Face-to-Face Credit Recovery for At-Risk Urban Students. Journal of Research on Educational Effectiveness, 10(2), 272-296. http://dx.doi.org/10.1080/19345747.2016.1168500

Joosten, T. & Cusatis, R. (2019). “A cross-institutional study of instructional characteristics and student outcomes: are quality indicators of online courses able to predict student success?” Online Learning, 23(4), 354-378. doi:10.24059/olj.v23i4.1432

Kamaruddin, Norfadilah. (2010). Interface design development: Malaysian’s practice. The International Journal of Learning, 17(8), 195‐204.

Karim, M. W., Haque, A., Ulfy, M. A., & Hossin, M. S. (2021). Factors Influencing Student Satisfaction towards Distance Learning Apps During the Coronavirus (Covid-19) Pandemic in Malaysia. International Journal of Academic Research in Progressive Education and Development, 10(2), 245–260. http://dx.doi.org/10.6007/IJARPED/v10-i2/9546

King S. B. (2014). Graduate student perceptions of the use of online course tools to support engagement. International Journal for the Scholarship of Teaching and Learning, 8(1). doi:10.20429/ijsotl.2014.080105

Klassen, R. M. (2010). Confidence to manage learning: The self-efficacy for self-regulated learning of early adolescents with learning disabilities. Learning Disabilities Quarterly, 33, 19-30. https://doi.org/10.1177/073194871003300102

Krejce, R.V., & Morgan, D.W. (1970). Determining Sample Size for Research Activities. Educational and Psychological Measurement, 30, 607-610. https://doi.org/10.1177/001316447003000308

Kruger, Justin and Dunning, David. (1999). Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6),1121-1134. doi:10.1037/0022-3514.77.6.1121

Ledrman, Doug (2020). Will Shift to Remote Teaching Be Boon or Bane for Online Learning? https://www.insidehighered.com/digital-learning/article/2020/03/18/most-teaching-going-remote-will-help-or-hurt-online-learning

Li, J., Ye, H., Tang, Y., Zhou, Z., & Hu, X. (2018). What are the effects of self-regulation phases and strategies for Chinese students? A meta-analysis of two decades’ research of the association between self-regulation and academic performance. Frontiers in Psychology, 9, Article 2434. https://doi.org/10.3389/fpsyg.2018.02434

Lilian Anthonysamy, Koo Ah Choo & Hew Soon Hin (2021). Investigating self-regulated learning strategies for digital learning relevancy. Malaysian Journal of Learning and Instruction, 18(1), 29-64. https://doi.org/10.32890/mjli2021.18.1.2

Livia Morris (2020). Spring Quarter Snapshot: Interviews Focus on How the Coronavirus is Changing Work. https://www.ucdavis.edu/spring-snapshots/news/interviews-focus-how-coronavirus-changing-work

Loeb, S. (2020). Students who struggle will likely struggle more online. https://www.edweek.org/ew/articles/2020/03/23/how-effective-is-online-learning-what-the.html

Lorezo-Alvarez, R., T. Rudolphi-Solero, T., Ruiz-Gomez, M.J. & Sendra-Portero, F. (2019). “Medical student education for abdominal radiographs in a 3D virtual classroom versus traditional classroom: a randomized controlled trial,” American Journal of Roentgenology, 213(3), 644-650. doi: 10.2214/ajr.19.21131.

Lucker, G. W., Beane, W. E., & Guire, K. (1981). The idiographic approach to physical attractiveness research. Journal of Psychology, 107, 57-67. https://doi.org/10.1080/00223980.1981.9915205

McVay, M. (2000). How to be a successful distance learning student: Learning on the Internet. Pearson Custom Publication.

Meyer, K. A. (2014). Student engagement in online learning: What works and why. ASHE Higher Education Report, 40(6), 1–114. doi:10.1002/aehe.20018.

Moody, J. (2019). What a Good College GPA Is and Why It Matters. https://www.usnews.com/education/best-colleges/articles/2019-01-28/what-a-good-college-gpa-is-and-why-it-matters

Michaelides, M. (2008). Emerging themes from early research on self-efficacy beliefs in school mathematics. Electronic Journal of Research in Educational Psychology, 6(1), 219-234.

Muda, Z., & Mohamed, R. (2016). Adaptive User Interface Design in Multimedia Courseware. Proceeding of Conference on Information and Communication Technologies, 16(1), 196‐ 199.

Pallot, R. M., & Pratt, K. (1999). Building Learning Communities in Cyberspace. San Francisco: Jossey-Bass.

Pennycook, G., Ross, R. M., Koehler, D. J. & Fugelsang, J. A. (2017). Dunning-Kruger effects in reasoning: Theoretical implications of the failure to recognize incompetence. Psychonomic Bulletin & Review, 24(6), 1174-1784. https://doi.org/10.3758/s13423-017-1242-7

Said, Ghada Refaat El. (2021). How Did the COVID-19 Pandemic Affect Higher Education Learning Experience? An Empirical Investigation of Learners’ Academic Performance at a University in a Developing Country", Advances in Human-Computer Interaction, 3, 1-10. https://doi.org/10.1155/2021/6649524

Soderstrom, N. C., & Bjork, R. A. (2015). Learning versus performance: An Integrative Review. Perspectives on Psychological Science, 10(2), 176–199. http://doi:10.1177/1745691615569000.

Soesanto, T. & Bonner, S. (2019). Dual mode delivery in an introductory statistics course: design and evaluation, Journal of Statistics Education, 27(2), 90-98. https://doi.org/10.1080/10691898.2019.1608874

Sun, P. C., Tsai, R. J., Finger, G., Chen, Y.-Y., & Yeh, D. (2008). What drives a successful eLearning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education, 50(4), 1183-1202.

Vo, H. M., Zhu, C., & Diep, N. A. (2017). The effect of blended learning on student performance at course-level in higher education: A meta-analysis. Studies in Educational Evaluation, 53, 17–28. http://doi: 10.1016/j.stueduc.2017.01.002

von Glasersfeld, E. (1983). Learning as a constructive activity. http://www.vonglasersfeld.com/083

Webb, E. J., Campbell, D. T., Schwartz, R. D., and Sechrest, L. (1966). Unobtrusive measures: Nonreactive research in the social sciences. Chicago: Rand-McNally.

Wheatley, G.H. (1991), Constructivist Perspectives on Science and Mathematics Learning, Science Education, 75(1), 9-12. http://dx.doi.org/10.1002/sce.3730750103

Yang, J. C., Quadir, B., Chen, N. S., & Miao, Q. (2016). Effects of online presence on learning performance in a blog-based online course. Internet and Higher Education, 30, 11–20. https://doi.org/10.1016/j.iheduc.2016.04.002.

York, T. T., Gibson, C.& Rankin, S. (2015). Defining and Measuring Academic Success. Practical Assessment, Research, and Evaluation, 20(5), 1-20. https://doi.org/10.7275/hz5x-tx03

Zahir Osman, Wardah Mohamad, Ratna Khuzaimah Mohamad, Liana Mohamad, & Tuan Fatma Tuan Sulaiman. (2018). Enhancing students’ academic performance in Malaysian online distance learning institutions. Asia Pacific Journal of Educators and Education, 33, 19–28. https://doi.org/10.21315/apjee2018.33.2

Additional Files

Published

10-01-2023

How to Cite

a/l Aperapar Singh, P. S., & Anthonysamy , L. . . (2023). THE DICHOTOMIZATION OF OBJECTIVE AND SUBJECTIVE OUTCOME MEASURES OF ACADEMIC PERFORMANCE IN AN ONLINE LEARNING ENVIRONMENT. Malaysian Journal of Learning and Instruction, 20(1), 63–92. https://doi.org/10.32890/mjli2023.20.1.3