Towards Applying Natural Language Approach in Improving Students' Writing Skills: Lecturer Feedback Tools (LeFT)

Hasniza  Nordin; Juhaida  Abu Bakar; Tengku Faekah  Tengku Ariffin; Nurbaya  Ghazali

doi:10.32890/jdsd2023.1.7

Authors

Hasniza Nordin Universiti Utara Malaysia, Malaysia
Juhaida Abu Bakar Universiti Utara Malaysia, Malaysia
Tengku Faekah Tengku Ariffin Universiti Utara Malaysia, Malaysia
Nurbaya Ghazali Politeknik Sultan Abdul Halim Mu’adzam Shah, Malaysia

DOI:

https://doi.org/10.32890/jdsd2023.1.7

Keywords:

Text summarisation, scaffolding, natural language processing, writing skills, web-based application

Abstract

Automatic text summarisation involves creating a concise and coherent description while preserving essential information and context. Time constraints faced by educators prompted this study. Writing is a crucial skill for students, especially in English; however, many need more feedback on their mistakes. Writing, akin to scaffolding, necessitates the involvement of proficient essay writers to assess and review students' work. Scaffolding facilitates student engagement and improves learning outcomes, making it an effective instructional strategy. To address this issue, Lecturer Feedback Tools (LeFT), a Natural Language Processing web application system, is introduced to educators to provide feedback to enhance students' writing skills. It utilises four summarisations SpaCy, Gensim, Natural Language Toolkit, and Sumy. What sets this tool apart is its ability to record all operations in a database, ultimately boosting educators' productivity and students' work. The evaluation results show a consensus among participants, with 66.7% expressing the system's usefulness and 83.3% finding it easy to use, reflecting their satisfaction with the study's outcomes.

References

Adediran, T. V., & Al Bazi, A. (2018). Developing an agent-based heuristic optimisation system for complex flow shops with customer-imposed production disruptions. Journal of Information and Communication Technology, 18(2), 291-322.

Agbe, J. (2019). Machine learning Web Apps. https://github.com/Jcharis/Machine-Learning-Web-Apps/tree/master/Summaryzer_Text_Summarization_App/

Allahyari, M., Pouriyeh, S., Assefi, M., Safaei, S., Trippe, E. D., Gutierrez, J. B., & Kochut, K. (2017). Text summarisation techniques: a brief survey. arXiv preprint arXiv:1707.02268.

Bhatia, N., Jaiswal, A.: Trends in extractive and abstractive techniques in text summarisation. International Journal of Computer Applications 117(6) (2015)

Belland, B. R., Walker, A. E., Kim, N. J., & Lefler, M. (2017). Synthesising results from empirical research on computer-based scaffolding in STEM education: A meta-analysis. Review of Educational Research, 87(2), 309-344.

Beltagy, I., Peters, M.E., Cohan, A.: Longformer: The long-document transformer. arXiv preprint arXiv:2004.05150 (2020)

Chary, M., Parikh, S., Manini, A. F., Boyer, E. W., & Radeos, M. (2019). A review of natural language processing in medical education. Western Journal of Emergency Medicine, 20(1), 78.

Chen, S. (2022). Abstractive Text Summarisation for Tweets. Master's Projects. San Jose State University. SJSU ScholarWorks.

Dalal, V., Malik, L.: A survey of extractive and abstractive text summarisation techniques. In: 2013 6th International Conference on Emerging Trends in Engineering and Technology, pp. 109–110. IEEE (2013)

Doo, M. Y., Bonk, C., & Heo, H. (2020). A meta-analysis of scaffolding effects in online learning in higher education. International Review of Research in Open and Distributed Learning, 21(3), 60-80.

Erkan, G., & Radev, D.R.(2004). Lexrank: Graph-based lexical centrality as salience in text summarisation. Journal Of Artificial Intelligence Research, 22, 457–479.

Hussain, A., Mutalib, N. A., & Yasin, A. (2014, June). jFakih: modelling mobile learning game. In 2014 International Conference on Computer and Information Sciences (ICCOINS) (pp. 1-6). IEEE.

Jnr, B. A., Majid, M. A., & Romli, A. (2018). An empirical study on predictors of green sustainable software practices in Malaysian electronic industries. Journal of Information and Communication Technology, 17(2), 347-391.

Kandpal, P., Wadkar, Y., Attri, H., & Bhorge, S. (2020, December). Comparison of Sentiment Analysis on Auto-Summarized Text and original Text using various Summarization Techniques. In 2020 IEEE Pune Section International Conference (PuneCon) (pp. 206-211). IEEE.

Lende, S. P., & Raghuwanshi, M. M. (2016, February). Question answering system on education acts using NLP techniques. In 2016 world conference on futuristic trends in research and innovation for social welfare (Startup Conclave) (pp. 1-6). IEEE.

Lewis, J. R. (1992). Psychometric evaluation of the post-study system usability questionnaire: The PSSUQ. In Proceedings of the Human Factors Society annual meeting (Vol. 36, No. 16, pp. 1259–1260). Sage CA: Los Angeles, CA: Sage Publications.

Lewis, M., Liu, Y., Goyal, N., et al. (2019). Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461

Luhn, H.P. (1958). The automatic creation of literature abstracts. IBM Journal of research and development, 2(2), 159–165.

Lund, A. M. (2001). Measuring usability with the use of a questionnaire12. Usability interface, 8(2), 3–6.

Martin, J. (1991). Rapid application development. Macmillan Publishing Co., Inc.

Mihalcea, R., Tarau, P. & Textrank (2004): Bringing order into text. In Proceedings of The 2004 Conference on Empirical Methods in Natural Language Processing, pp. 404–411.

Miller, D. (2019). Leveraging BERT for extractive text summarisation on lectures. arXiv preprint arXiv:1906.04165

Sawicki, J., Ganzha, M., Paprzycki, M., et al. (2023). The state of the art of Natural Language Processing— a systematic automated review of NLP literature using NLP techniques. Data Intelligence, 5(3), 707-749.

Steinberger, J. & Jezek, K. (2004). Using latent semantic analysis in text summarisation and summary evaluation. Proc. ISIM, 4, 93–100.

Yu, J., Luo, G., Xiao, T., Zhong, Q., Wang, Y., Feng, W.,... & Tang, J. (2020, July). MOOCCube: a large-scale data repository for NLP applications in MOOCs. In Proceedings of the 58th annual meeting of the Association for Computational Linguistics (pp. 3135–3142).

Zhang, J., Zhao, Y., Saleh, M., et al. (2020). Pegasus: Pre-training with extracted gap-sentences for abstractive summarisation. In International Conference on Machine Learning, pp. 11328–11339.