Cognitive Theory of Multimedia Learning Powered Code-Switching Interface for Vocabulary Acquisition of ESL Students
DOI:
https://doi.org/10.17507/jltr.1406.01Keywords:
vocabulary, Code-Switching, CTML, long-term memory, mother-tongueAbstract
The purpose of the paper is to use multimedia as a method to improve proficiency in vocabulary of undergraduate students from the level B1 to B2 (CEFR). The term "code-switching" is used to describe the use of multiple languages during a single discourse. Human minds can take in so much data before they get overwhelmed. The quality of that limited space can be improved by incorporating visual attention alongside verbal attention in order to create mental representations that are utilised to digest incoming information. “People learn more deeply from words and pictures than from words alone” (Mayer, 21). This research builds on previous work in this area by making use of multimedia materials that feature both the learners’ native language and English subtitles. This creates mental space for the students, which in turn guides them to a vocabulary-learning interface. CTML was employed to conduct a quantitative study between the age groups 17 and 20. Using a random sampling technique, researchers collected data from a total of 40 individuals. ANOVA (Analysis of Variance), independent t-tests, and paired t-tests were used to examine the use of Code-Switching in the experimental group and its statistical significance relative of the control group. The findings of the study suggest that utilising CTML can help non-native speakers of English improve their language through code-switching. There was a significant advancement in the vocabulary usage of the experimental samples of those who participated in the study.
References
Al Seghayer, K. (2001). The effect of multimedia annotation modes on L2 vocabulary acquisition: A comparative study. Language Learning & Technology, 5(1), 202-232.
Bates, A. W. (1985). Using Video in Higher Education. IET Paper on Broadcasting, 243, 2-15.
Butcher, K. R. (2006). Learning from text with diagrams: Promoting mental model development and inference generation. Journal of educational psychology, 98(1), 182-197.
Chintalapalli, V. (2021). Understanding Language Learning in Online Teaching. Modern English Teacher, 30(2), 60-62.
Clare, A. (2017). The Image in English Language Teaching (1st ed., pp. 33-42). Malta: ELT council.
Clark, J. M., & Paivio, A. (1991). Dual coding theory and education. Educational psychology review, 3(3), 149-210.
Clark, J. M., & Paivio, A. (1987). A dual coding perspective on encoding processes. In Imagery and related mnemonic processes (pp. 5-33). Springer, New York, NY.
Cook, V. (2002) Portraits of the L2 User. Cleverdon: Multilingual Matters.
Etemadi, A. (2012). Effects of bimodal subtitling of English movies on content comprehension and vocabulary recognition. International journal of English linguistics, 2(1), 239-248.
Gorjian, B. (2014). The effect of movie subtitling on incidental vocabulary learning among EFL learners. International Journal of Asian Social Science, 4(9), 1013-1026.
Hulstijn, J. H. (2007). Fundamental issues in the study of second language acquisition. EuroSLA Yearbook, 7(1), 191-203.
Krashen, S. D., Terrell, T. D., Ehrman, M. E., & Herzog, M. (1984). A theoretical basis for teaching the receptive skills. Foreign Language Annals, 17(4), 261-275.
Kirschner, P. A., & Neelen, M. (2017). Double-barrelled learning for Young & Old. 3. Retrieved August 17, 2022, from https://3starlearningexperiences.wordpress.com/2017/05/30/double-barrelled-learning-for-young-old/
Lertola, J. (2012). The effect of the subtitling task on vocabulary learning. Translation research projects, 4, 61-70.
Ljubojevic, M., Vaskovic, V., Stankovic, S., & Vaskovic, J. (2014). Using supplementary video in multimedia instruction as a teaching tool to increase efficiency of learning and quality of experience. The International Review of Research in Open and Distance Learning, 15(3), 275-291.
Mayer, R. E. (2021). Multimedia learning. Cambridge University Press.
Mayer, R. E. (2014). The Cambridge Handbook of Multimedia Learning. Cambridge University Press.
Mayer, R. E., & Fiorella, L. (2014). 12 principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In The Cambridge handbook of multimedia learning (Vol. 279). New York, NY: Cambridge University Press.
Mayer, R. E. (2010). Applying the science of learning to medical education. Medical Education, 44: 543–549.
Mayer, R. E. (2008). Applying the science of learning: evidence-based principles for the design of multimedia instruction. American psychologist, 63(8), 760-769.
Mayer, R. E. (2005). Cognitive theory of multimedia learning. In R.E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning. New York: Cambridge University Press.
Mayer, R. E. (2005a). Introduction to multimedia learning. In R.E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning. New York: Cambridge University Press.
Mayer, R. E. (1997). Multimedia learning: Are we asking the right questions?. Educational psychologist, 32(1), 1-19.
Mayer, R. E., & Sims, V. K. (1994). For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning. Journal of educational psychology, 86(3), 389-401.
Modupeola, O. R. (2013). Code-Switching as a teaching strategy: Implication for English Language teaching and learning in a multilingual society. IOSR Journal of Humanities and Social Science, 14(3), 92-94.
Moeser, S. D., & Bregman, A. S. (1973). Imagery and language acquisition. Journal of Verbal Learning and Verbal Behavior, 12(1), 91-98.
Moore, D (2010) Code-switching and Learning in the Classroom. International Journal of Bilingual Education and Bilingualism, 5(5), 279-293. doi: https://doi.org/10.1080/ 13670050208667762
Paivio, A. (2014). Mind and its evolution: A dual coding theoretical approach. Psychology Press.
Paivio, A. (1990). Mental representations: A dual coding approach. Oxford University Press.
Paradowski, M. (2008). Corroborating the role of L1 awareness in FL pedagogy. In 33rd international LAUD symposium. Cognitive approaches to second/foreign language processing: Theory and pedagogy. Essen: Landau/Pfalz, 515–580. Retrieved August 17, 2022, from https://files.eric.ed.gov/fulltext/ED501918.pdf
Price, K. (1983). Closed-captioned TV: An untapped resource. Matsol Newsletter, 12(2), 1-8.
Reed, S. K. (2022). Cognition: Theories and applications. Sage.
Sadiku, A. (2018). The role of subtitled movies on students’ vocabulary development. Int. J. Sci. Basic Appl. Res, 42, 212-221.
Sorden, S. D. (2012). The cognitive theory of multimedia learning. Handbook of educational theories, 1(2012), 1-22.
Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. In R.E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning. New York: Cambridge University Press.
Talaván, N. (2010). Subtitling as a task and subtitles as support: Pedagogical applications. In New insights into audiovisual translation and media accessibility (pp. 285-299). Brill.
Wilang, J. (2021). A positive approach to (online) English language teaching. Modern English Teacher, 30(2), 21-23.
Üstunel, E. (2016). EFL classroom code-switching. Turkey: Palgrave Macmillan
Uys, D., & van Dulm, O. (2011). The function of classroom code-switching in the Siyanda district of the Northern Cape. Southern African Linguistics and applied language studies, 29(1), 67- 76. doi:https://doi.org/10.2989/16073614.2011.583159.
