Bilingual Test as a Test Accommodation to Determine the Mathematics Achievement of Mainstream Students With Limited English Proficiency

Authors

  • S. Kanageswari Suppiah Shanmugam Seameo Regional Center for Education in Science and Mathematics Seameo Recsam, Penang, Malaysia
  • Ong Saw Lan School of Educational Studies Universiti Sains Malaysia, Malaysia

DOI:

https://doi.org/10.32890/mjli2013.10.2

Keywords:

Computation testlet, word problem testlet, LEP, bilingual test, English-only test, mathematics achievement

Abstract

Purpose â€“ This study aims to investigate the validity of using bilingual test to measure the mathematics achievement of students who have limited English proficiency (LEP). The bilingual test and the English-only test consist of 20 computation and 20 word problem multiple-choice questions (from TIMSS 2003 and 2007 released items. The bilingual test consists of items in Malay and English languages. The English teachers classified their students into LEP and non-LEP groups.
 
Methodology â€“ A total of 2,021 LEP and 2,747 non-LEP students from 34 schools were identified. Spiral administration was employed. A total of 2,399 students sat for the bilingual test and 2,369 for the English-only test. The scores were linked using RAGE-RGEQUATE version 3.22.
 
Findings â€“ Findings revealed that in the word problem testlet, the bilingual test was one unit easier for LEP students, probably indicating that the Malay language adaptation assisted them. For the non-LEP students, the bilingual version did not provide any added advantage to them as they did not show elevated achievement score.
 
Significance â€“ This study indicates bilingual test can be an appropriate test accommodation that validly measures both LEP and non-LEP students’ mathematics achievement in countries where English is not the native language but is used as the instructional language.
 

References

Abedi, J., & Lord, C. (2001). The language factor in Mathematics test. Applied Measurement in Education, 14(3), 219-234.

Abedi, J., Courtney, M., Mirocha, J., Leon, S., & Goldberg, J. (2005). Language accommodations for English language learners in large-scale assessments: Bilingual dictionaries and linguistic modification. CSE Report 666. Retrieved from http://www. cse/ucla.edu/products/reports/r666.pdf

Abedi, J., Lord C., & Plummer, J. R. (1997). Final report of language background as a variable in NAEP mathematics performance (CSE Tech. Rep. No. 429). Los Angeles: University of California, Center for the Study of Evaluation/ National Center for Research on Evaluation, Standards, and Student Testing. Retrieved from http://cunningham.acer.edu. au/inted/onlinedocs/1999/112897.pdf

Ain Nadzimah Abdullah & Chan, S. W. (2003). Gaining linguistic capital through a bilingual language policy innovation. South Asian Language Review. XIII,1-2. American Educational Research Association, American Psychological Association & National Council on Measurement in Education. (1999). Standard for Educational and Psychological Testing. Washington, DC: American Psychological Association

Anderson, J. (2007). The Mathematics of language. Harvard Graduate School of Education. Retrieved from http://www.gse.harvard. edu/news_events/features/2007/03/22_martiniello.php

Ansley, T. N., & Forsyth, R. A. (1990). An investigation of the nature of the interaction of reading and computational abilities in solving Mathematics word problems. Applied Measurement in Education, 3(4), 319-329.

Baker, C. (1996). Foundations of bilingual education and bilingualism. Great Britain: Bath Press.

Bernardo, A. B. I. (1999). Overcoming obstacles to understanding and solving word problems in mathematics. Educational Psychology, 19, 149-163.

Bernardo, A. B. I. (2005). Language and modelling word problems in Mathematics among bilinguals. The Journal of Psychology, 139(5), 413-425.

Brown, C.L. (2005). Equity of literacy-based Math performance assessment for English Language Learners. Bilingual Research Journal, 29(2), 337-364.

Clements, M. A. K. (1980). Analysing children’s errors on written mathematical tasks. Educational Studies in Mathematics, 11, 1-21.

Collier, V. (1987). Age and rate of acquisition of second language for academic purposes. TESOL Quarterly, 21, 617-641.

Cummins, J. (1984). Bilingualism and special education: Issues in assessment and pedagogy. Great Britain: Short Run Press Ltd.from http://www.iteachilearn.com/cummins/bicsalp.html

Curriculum Development Centre. (2003a). Curriculum specifications mathematics form one. Ministry of Education, Dewan Bahasa dan Pustaka: Kuala Lumpur, Malaysia.

Curriculum Development Centre (2003b). Curriculum specifications mathematics form two. Ministry of Education, Dewan Bahasa dan Pustaka: Kuala Lumpur, Malaysia.

Duncan, T.G., et al., (2005). Study of a dual-language test booklet in eighth-grade Mathematics. Journal of Applied Measurement in Education, 18(2), 129-161.

Fatimah Hashim & Zarina Ramlan (2004). Language literacy impacting on mathematical literacy: Challenges for low proficiency ESL learners. ETY Journal 5(2), 11-14.

Ferari, P.F. (2004). Mathematical language and advanced Mathematics learning. Proceedings of the 28th Conference of the International Group for the Psychology of Mathematics Education, July 14-18, Bergen, Norway, 2, 383-390.

Gierl, M. J., & Khaliq, S.H. (2001). Identifying sources of differential item and bundle functioning on translated achievement tests: A confirmatory analysis. Journal of Educational Measurement, 38 (2), 164-187.

Hambleton, R. K., & Patsula, L. (1999). Increasing the validity of adapted tests: Myths to be avoided and guidelines for improving test adaptation practices [Electronic version]. Retrieved from http://www.testpublishers.org/journal01.htm

Henrysson, S. (1971). Gathering, analyzing, and using data on test items. In R. L. Thorndike (Ed.), Educational measurement (pp. 130-159). Washington, D.C.: American Council on Education.

Holland, P. W., & Dorans, N.J. (2006). Linking and Equating. In R. L. Brennan (Ed.), Educational measurement (pp. 187-220). United States of America: Praeger Publishers. International Association for the Evaluation of Educational

Achievement. (2007). TIMSS-USA-8 Mathematics items. Retrieved 11 November, 2007, from http://nces.ed/gov/ Timss/pdf/IIMSS_Mathh_Items.pdf

Irujo, S. (2007). Teaching Math to English Language Learners: Can research help? ELL Outlook. Mac/April from http://www.coursescrafters.com/ELL-Outlook/2007/Mar apr/ELL OutlookITIN

Jean, I. J. (2006). Relationship between degree of bilingualism and mathematical word problem solving. Retrieved from http://www.ed.gov/rschstat/research/pubs/oieresearch/conference/ jean_200601.pdf

Khisty, L. (1993). A naturalistic look at language factors in Mathematics teaching in bilingual classroom. Paper presented at Third National Research Symposium on Limited English Proficient Student Issues: Focus on Middle and High School Issues, Washington, DC: U.D. Department of Education, Office of Bilingual and Minority Language Affairs. Retrieved from http://www.ncela.gwu.edu/files/rcd/BE019310/A Naturalistic_ Look.pdf

Kintsch, W., & Greeno, J. G. (1985). Understanding and solving word arithmetic problems. Psychological Review, 92(1), 109-129.

Kolen, M. J. (2005). RAGE-RGEQUATE (Version 3.22) [Computer software]. The University of Iowa, Iowa City: Iowa Testing Programs.

Kolen, M. J. & Brennan, R. L. (1995). Test equating: Methods and practices. Iowa City, USA: Springer-Verlag New York, Inc.

Lachat, M. A., & Spruce, M. (1998). Assessment reform, equity, and English language learners - Office of Educational Research and Improvement, Northeast and Island Regional Educational Laboratory at Brown University. Retrieved from http://www. alliance.brown.edu/pubs/asellblb.pdf

Li, Y. (1998). The role and use of word problems in school Mathematics. Edumath, 6. Retrieved from http://www.fed. cuhk.edu.hk/~fllee/mathfor/edumath/9806/10li_yp.html

Lim, C. S. (2002). Cultural differences and mathematics learning in Malaysia [Electronic version]. Retrieved from http://www. math.admu.edu/tsg22/lim.html

Mather, R. C. & Chiodo, J.J. (1994). A mathematical problem: How do we teach Mathematics to LEP elementary students? The Journal of Educational Issues of Language Minority Students, 13, 1-12.

National Association for the Education of Young Children. (2005). Screening and assessments of young English-language learners. Retrieved from http://www.naeyc.org/about/positions/ ELL_Supplement.asp

Nesher, P., & Katriel, T. (1977). A semantic analysis of addition and subtraction word problems in arithmetic. Educational Studies in Mathematics, 8, 251-269.

Oviedo, G. C. B. (2005). Comprehending algebra word problems in the first and second languages. In J. Cohen, K. T. McAlister, K. Rolstad & J. Macswan (Eds.), Proceedings of the 4th International Symposium on Bilingualism (pp. 267-295). Somerville, MA: Cascadilla Press.

Rapp, J., & Allalouf, A. (2003). Evaluating cross-lingual equating. International Journal of Testing, 3(2), 101-117.

Reed, S.K. (1999). Learning rules in word problems: Research and Curriculum Reform. Lawrence Erlbaum Associates. Retrieved from http://books.google.com.my/books?id=0FcfDR4PBHOC7 dq=nctm= (Word Problem).

Robertson, S., & Summerlin, J. (2005). Mathematics and English language learners: A review of the literature. Retrieved from http://www.education.txsatte.edu/epic/mellwebdocs/SRS Ulitreview.htm.

Schulte, A. G., Elliott, S. N., & Kratochwill, T. R. (2001). Experimental analysis of the effects of testing accommodations on students’ standardized achievement test scores. School Psychology Review, 30(4), 527-547.

Sireci, S. G. (1997). Problems and issues in linking tests across languages. Journal of Educational Measurement, 16(1), 12-19.

Stansfield, C. W. (1997). Experience and issues related to the format of bilingual tests: Dual language test booklets versus two different test booklets. Retrieved from http://www.eric. ed.gov/PDFS/ED419002.pdf

Tinkelman, S. N. (1971). Planning the objective test. In R. L. Thorndike (Ed.), Educational measurement (pp. 46-80). Washington, D.C.: American Council on Education.

Valentin, J.D., & Lim, C.S. (December, 2004). Roles of semantic structure of arithmetic word problems on pupil’s ability to identify the correct operation. Retrieved from http://www. cimt.plymouth.ac.uk/journal/valentin.pdf

Virginia Department of Education. (2004). Mathematics: Strategies for teaching limited English proficient students. Retrieved from http://www.pen.k12.va.us/VDOE/Instruction/ESL/LEP mathResource.pdf

Wang, M. C., Reynolds, M. C., & Walberg, H. J. (1991). Emerging programmes: Handbook of special education research and practice, 4. New York: Pergamon Press.

Wilde, J. (2007). Resources about accommodations for English language learners. National Clearinghouse for English language acquisition and language instruction educational programs. Retrieved from http://www.nclea.gwu.edu/resabout/ accomodations/intro/index.html

Downloads

Published

26-12-2013

Issue

Vol. 10 (2013): Malaysian Journal of Learning and Instruction (MJLI) Vol. 10, 2013

Section

Articles

How to Cite

Shanmugam, S. K. S., & Lan, O. S. (2013). Bilingual Test as a Test Accommodation to Determine the Mathematics Achievement of Mainstream Students With Limited English Proficiency. Malaysian Journal of Learning and Instruction, 10, 29-55. https://doi.org/10.32890/mjli2013.10.2

Research impact

Harvested 2026-09-22
0 citations recorded so far

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/mjli2013.10.2