Reliability and Validity of the Instrument for Measuring Malaysian Polytechnic English Language Educators’ Perception Towards the CEFR Implementation

Rabiatul Adawiyah  Abdullah Zawawi; Ahmad Zaidi  Hussin

doi:10.32890/pr2024.6.5

Authors

Rabiatul Adawiyah Abdullah Zawawi Universiti Utara Malaysia, Malaysia
Ahmad Zaidi Hussin Universiti Utara Malaysia, Malaysia

DOI:

https://doi.org/10.32890/pr2024.6.5

Keywords:

Malaysian polytechnics, Common European Framework of Reference for Languages (CEFR), Cronbach’s alpha, Exploratory Factor Analysis (EFA)

Abstract

This study set out to find out how Malaysian Polytechnic English language instructors felt about the Common European Framework
of Reference for Languages’ launch (CEFR). The literature review highlighted the issues with changing policies, adapting curricula, and
the difficulties experienced by English language teachers. 30 English educators of different Malaysian polytechnics were approached and requested to complete a self-administered questionnaire via Google Forms to obtain the data. The response was analyzed for reliability and validity with Cronbach’s alpha and Exploratory Factor Analysis (EFA). Three key factors were recognized and validated using Exploratory Factor Analysis: the educators’ familiarity, the educators’ acceptance, and the educators’ challenges. The questionnaire, which consists of 15 items and uses a 6-point Likert scale with 5 = Agree, 4 = Slightly Agree, 3 = Slightly Disagree, 2 = Disagree, and 1 = Strongly Disagree, has been shown to be extremely dependable.

References

Abi Maryo, F. A. (2021). The Issues of the Implementation of CEFR in Indonesia. Aplinesia (Journal of Applied Linguistics Indonesia), 5(1), 18-22.

Adelia, R. K. (2023). The Correlation between Readability Level and Learners’ Reading Comprehension in Narrative Reading Texts of Tenth Grade (Doctoral dissertation, UIN Raden Intan Lampung).

Alih, N. A. C., Raof, A. H. A., & Yusof, M. A. M. (2021). Policy change implementation: The case of the CEFR in Malaysian ESL Classrooms. Journal of Nusantara Studies, 6(2), 296-317. Practitioner Research, 6, July 2024 pp: 85-

Alih, N. A. C., Yusoff, M. A. M., & Abdul, A. H. (2020). Educators’ Knowledge and Belief on the CEFR Implementation in Malaysian ESL Classroom. Educational Research (IJMCER), 2(5), 126-134.

Alpaslan, M. M., Ulubey, Ö., & Ata, R. (2021). Adaptation of technological pedagogical content knowledge scale into Turkish culture within the scope of 21st-century skills. PsychoEducational Research Reviews, 10(1), 77-91.

Auerswald, M., & Moshagen, M. (2019). How to determine the number of factors to retain in exploratory factor analysis: A comparison of extraction methods under realistic conditions. Psychological methods, 24(4), 468.

Bullah, N. H., & Yunus, M. M. (2019). Educators’ perception on implementing Dual Language Programme (DLP) in urban schools. Asian Social Science, 15(1), 24-31. Darmi, R., Saad, N. S. M., Abdullah, N., Puteh-Behak, F., Zakaria,

Z. A., & Adnan, J. N. I. (2017). Teachers’ Views On Students’ Performance In English Language Proficiency Courses Via Cefr Descriptors. IJAEDU-International E-Journal of Advances in Education. De Winter*, J. C., Dodou*, D. I. M. I. T. R. A., & Wieringa, P.

A. (2009). Exploratory factor analysis with small sample sizes. Multivariate behavioral research, 44(2), 147-181.

Deygers, B., Zeidler, B., Vilcu, D., & Carlsen, C. H. (2018). One framework to unite them all? Use of the CEFR in European university entrance policies. Language Assessment Quarterly, 15(1), 3-15.

Don, Z. M. (2020). The CEFR and the production of spoken English: A challenge for educators. The English Educators, 49(3), 77–88. English in Education | British Council. (2023). Britishcouncil.org. https://www.britishcouncil.org/english-assessment/englishprogrammes/english-education

Fein, E. C., Gilmour, J., Machin, T., & Hendry, L. (2022). Section 8.5: EFA Interpretation. Usq.pressbooks.pub. https://usq. pressbooks.pub/statisticsforresearchlearners/chapter/efainterpretation/#:~:text=The%20pattern%20matrix%20 shows%20the ‌Fleckenstein, J., Keller, S., Krüger, M., Tannenbaum, R. J., & Köller,

O. (2020). Linking TOEFL iBT® writing rubrics to CEFR levels: Cut scores and validity evidence from a standard setting study. Assessing Writing, 43, 100420. Practitioner Research, 6, July 2024 pp: 85-

Foley, J. (2019). Issues on assessment using CEFR in the region. LEARN Journal: Language Education and Acquisition Research Network, 12(2), 28–48.

Green, A. (2018). Linking tests of English for academic purposes to the CEFR: The score user’s perspective. Language Assessment Quarterly, 15(1), 59–74.

Guerra, L., Gonçalves, O., Fisne, F. N., & Gungor, M. N. (2018). A CEFR-based comparison of ELT curriculum and course books used in Turkish and Portuguese primary schools.

Hazar, E. (2021). The Influence of the CEFR in Turkish National Curriculum. African Educational Research Journal, 9(2), 551–561.

He, L., & Chen, D. (2017). Developing common listening ability scales for Chinese learners of English. Language Testing in Asia, 7, 1-12. Hoque, A. S. M. M., Siddiqui, B. A., Awang, Z. B., & Baharu, S.

M. A. T. (2018). Exploratory factor analysis of Entrepreneurial orientation in the context of Bangladeshi small and medium Enterprises (SMEs). European Journal of Management and Marketing Studies.

Ishak, W. I. W., & Mohamad, M. (2018). The Implementation of Common European Framework of References (CEFR): WhatAre the Effects Towards LINUS Students’ Achievements?. Creative Education, 9(16), 2714-2731.

Kanchai, T. (2019). Thai EFL university educators’ viewpoints towards impacts of the CEFR on their English language curricula and teaching practice. NIDA Journal of Language and Communication, 24(35), 23–47.

Kaur, P., & Jian, M. Z. (2022). The CEFR-Aligned Curriculum: Perspectives of Malaysian Educators. Asian Journal of Research in Education and Social Sciences, 4(1), 138-145.

Khair, A. H. M., & Shah, P. M. (2021). ESL Educators’ Perceptions on Implementing CEFR in Malaysian Primary Schools: Issues and Challenges. Journal of Advances in Education Research, 6(1), 31.

Kok, N. M., & Aziz, A. A. (2019). English educators’ perceptions on the implementation of CEFR-aligned curriculum among primary schools in Malaysia. In Seminar Wacana Pendidikan (pp. 212-222).

Mohammed, N. A., Raof, A. H. A., & Yusof, M. A. M. (2021). Challenges in Implementing the CEFR in English Language Classrooms. LSP International Journal, 8(2), 115–128. Practitioner Research, 6, July 2024 pp: 85-

Mohd Don, Z., & Abdullah, M. H. (2019, May 27). What the CEFR is and is not - free Malaysia today, 27 mei 2019. MOE. Retrieved 7 April 2023, from https://www.moe.gov.my/en/menumedia/ printed-media/newspaper-clippings/what-the-cefr-is-and-isn-tfree-malaysia-today-27-mei-2019 Nawawi, N. M., Zuhaimi, N., Sabu, K., Mahamud, N. S. R., &

Nasir, N. A. M. (2021). CEFR for languages and its effective implementation in secondary schools in Malaysia. Asian Journal of Assessment in Teaching and Learning, 11(1), 63-72. Nawi, F. A. M., Tambi, A. M. A., Samat, M. F., & Mustapha, W. M.

W. (2020). A review on the internal consistency of a scale: the empirical example of the influence of human capital investment on Malcolm Baldridge quality principles in TVET institutions. Asian People Journal, 3(1), 19–29.

Ngo, X. M. (2017). Diffusion of the CEFR among Vietnamese educators: A mixed methods investigation. Asian EFL Journal, 19(1), 7–32.

Omar, S., Kamlun, K., & Lee, C. S. (2020). Exploring the Learners’ Perceptions of the Usefulness of CLIL Modules and ICT Integrated Learning in English Classroom. Palarch’s Journal of Archaeology of Egypt/Egyptology.

Pillai, S., & Ong, L. T. (2018). English (es) in Malaysia. Asian Englishes, 20(2), 147–157.

Rashid, R. A., Abdul Rahman, S. B., & Yunus, K. (2017). Reforms in the policy of English language teaching in Malaysia. Policy Futures in Education, 15(1), 100-112.

Sahib, F. H., & Stapa, M. (2022). Global trends of the Common European Framework of Reference: A bibliometric analysis. Review of Education, 10(1), e3331.

Shin, J. L. K., & Yunus, M. M. (2021). The attitudes of pupils towards using flip grid in learning English speaking skills. International Journal of Learning, Teaching and Educational Research, 20(3), 151-168.

Shrestha, N. (2021). Factor analysis as a tool for survey analysis. American Journal of Applied Mathematics and Statistics, 9(1), 4–11.

Sidhu, G. K., Kaur, S., & Chi, L. J. (2018). CEFR-aligned schoolbased assessment in the Malaysian primary ESL classroom. Indonesian Journal of Applied Linguistics, 8(2), 452-463.

Sürücü, L., & MASLAKÇI, A. (2020). Validity and reliability in quantitative research. Business & Management Studies: An International Journal, 8(3), 2694-2726. Practitioner Research, 6, July 2024 pp: 85-

Tosun, F. Ü., & Glover, P. (2020). How Do School Educators in Turkey Perceive and Use the CEFR? International Online Journal of Education and Teaching, 7(4), 1731-1739.

Uri, N. F. M., & Abd Aziz, M. S. (2018). Implementation of CEFR in Malaysia: Educators’ awareness and the challenges. 3L, Language, Linguistics, Literature, 24(3).

Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219-246.

Wudthayagorn, J. (2018). Mapping the CU-TEP to the Common European Framework of Reference (CEFR). LEARN Journal: Language Education and Acquisition Research Network, 11(2), 163-180.

Zaman, T. E. T. (2019). The Representation of English Language in the Malaysian Education Blueprint 2013-2025: A CDA Perspective. Lancaster University (United Kingdom).