Impact of AI-Generated Emotionally-Charged Images on Vocabulary Learning among Teenage EFL Learners
Subject Areas :
Reza Bakhsheshi-Atigh
1
,
Javad Gholami
2
,
Salva Kazemipour-Khabbazi
3
1 - Department of English Language and Literature, Faculty of letters and Humanities, Urmia University, Urmia, Iran
2 - Department of English Language and Literature at Urmia University, Urmia, IRAN.
3 - دانشگاه علوم پزشکی همدان
Keywords: AI-generated images, emotionally-charged stimuli, teenage EFL Learners, vocabulary retention,
Abstract :
This study examines whether emotionally-charged images created by Artificial Intelligence (AI) can improve vocabulary learning for teenage English as a Foreign Language (EFL) learners. Drawing on the Dual-Coding Theory and Multisensory Learning frameworks, the research explores how emotional stimuli influence vocabulary retention. A within-subjects experimental design was employed, involving 348 male students aged 12-16. Participants were exposed to vocabulary items paired with AI-generated images categorized by emotional valence (positive, negative, non-emotional) and tested on their retention through pretests and posttests. Results from a Repeated-Measures ANOVA revealed that both positive and negative emotional images significantly enhanced vocabulary retention compared to non-emotional images, with no significant difference between positive and negative stimuli. These findings suggest that emotional engagement, regardless of valence, plays a crucial role in enhancing memory and learning outcomes. The study underscores the potential of AI-generated emotionally charged visuals as a transformative tool in EFL education, offering educators innovative strategies to improve vocabulary retention. However, the study also highlights the need for further research to explore the interplay between emotional valence, cognitive load, and contextual learning environments. The findings advocate for the integration of emotionally resonant materials in language instruction to foster greater student engagement and optimize learning outcomes.
Alemi, M., & Tayebi, A. (2011). The influence of incidental and intentional vocabulary acquisition and vocabulary strategy use on learning l2 vocabularies. Journal of Language Teaching and Research, 2(1). https://doi.org/10.4304/jltr.2.1.81-98
Boers, F., Warren, P., He, L., & Deconinck, J. (2017). Does adding pictures to glosses enhance vocabulary uptake from reading? System, 66, 113–129. https://doi.org/10.1016/j.system.2017.03.017
Bradley, M. M., & Lang, P. J. (2007). The International Affective Picture System (IAPS) in the study of emotion and attention. In Handbook of Emotion Elicitation and Assessment (pp. 29-46). Oxford University Press.
Carpenter, S. K., & Olson, K. M. (2012). Are pictures good for learning new vocabulary in a foreign language? Only if you think they are not. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38(1), 92–101. https://doi.org/10.1037/a0024828
Castro, G. P. B., Chiappe, A., Rodriguez, D. F. B., & Sepulveda, F. G. (2024). Harnessing AI for education 4.0: drivers of personalized learning. Electronic Journal of E-Learning, 22(5), 01-14. https://doi.org/10.34190/ejel.22.5.3467
Chen, C.-M., Liu, H., & Huang, H.-B. (2019). Effects of a mobile game-based English vocabulary learning app on learners’ perceptions and learning performance: A case study of Taiwanese EFL learners. ReCALL, 31(2), 170–188. https://doi.org/10.1017/s0958344018000228
Chen, Q., Liu, S., Huang, K., Wang, X., Ma, X., Zhu, J., & Peng, Z. (2024, July 1-4). RetAssist: Facilitating vocabulary learners with generative images in story retelling practices [Paper presentation]. Designing Interactive Systems Conference, IT University of Copenhagen, Denmark. https://doi.org/10.1145/3643834.3661581.
Chung, D. T. K. (2023). The efficacy of visual aids in enhancing vocabulary acquisition in EFL classes. International Journal of Social Science and Human Research, 6(10), 6397–6403. https://doi.org/10.47191/ijsshr/v6-i10-80
Chung, S., & Cheon, J. (2020). Emotional design of multimedia learning using background images with motivational cues. Journal of Computer Assisted Learning, 36(6). https://doi.org/10.1111/jcal.12450.
Citron, F. M., Weekes, B. S., & Ferstl, E. C. (2013). Effects of valence and arousal on written word recognition: time course and ERP correlates. Neuroscience letters, 533, 90–95. https://doi.org/10.1016/j.neulet.2012.10.054
Creely, E. (2024). Exploring the role of generative ai in enhancing language learning: Opportunities and challenges. International Journal of Changes in Education, 1(3). https://doi.org/10.47852/bonviewIJCE42022495
Dewaele, J.-M. (2023). Emotions in second language acquisition: A critical review and research agenda. Language Teaching, 56(1), 1-20. https://doi.org/10.1017/S0261444822000314
Dörnyei, Z. (2009). The psychology of second language acquisition. Oxford University Press.
Dörnyei, Z., & Ryan, S. (2015). The psychology of the language learner revisited. Routledge.
Gong, S., Shangguan, C., Zhai, K., & Guo, Y. (2017). The effects of emotional design on multimedia learning. Acta Psychologica Sinica, 49(6), 771. https://doi.org/10.3724/sp.j.1041.2017.00771
Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. The MIT Press.
Hu, H. M., & Nassaji, H. (2016). Effective vocabulary learning tasks: Involvement Load Hypothesis versus Technique Feature Analysis. System, 56, 28–39. https://doi.org/10.1016/j.system.2015.11.001
Immordino-Yang, M. H., & Damasio, A. (2007). We feel, therefore we learn: The relevance of affective and social neuroscience to education. Mind, Brain, and Education, 1(1), 3–10. https://doi.org/10.1111/j.1751-228x.2007.00004.x
Ironsi, C. S. (2024). Exploring the potential of generative ai in english language teaching. Facilitating Global Collaboration and Knowledge Sharing in Higher Education with Generative AI, 162–185. https://doi.org/10.4018/979-8-3693-0487-7.ch007
Kensinger, E. A., & Corkin, S. (2003). Memory enhancement for emotional words: Are emotional words more vividly remembered than neutral words? Memory & Cognition, 31(8), 1169–1180. https://doi.org/10.3758/bf03195800
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1998). Emotion, motivation, and anxiety: brain mechanisms and psychophysiology. Biological psychiatry, 44(12), 1248–1263. https://doi.org/10.1016/s0006-3223(98)00275-3
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2008). International Affective Picture System (IAPS): Affective ratings of pictures and instruction manual (Technical Report No. A-8). University of Florida, Center for the Study of Emotion and Attention.
Lehikko, A., & Nykänen. (2024, August 21-23). A mixed-methods study on learner-IVR interactivity, agency, cognitive load and learning outcomes [Paper presentation]. European Association for Research on Learning and Instruction SIG 6 & 7 Conference 2024, Tübingen, Germany.
Lewis, M. 2005. Bridging emotion theory and neurobiology through dynamic systems modeling. Behavior and Brain Sciences, 28 (2), 169–245. https://doi.org/10.1017/S0140525X0500004X
Lidwell, W., Holden, K., & Butler, J. (2003). Universal principles of design. Gloucester, MA: Rockport.
Luckin, R., Holmes, W., Griffiths, M., & Pearson, L. (2016). Intelligence unleashed: An argument for AI in education. Open Ideas; Pearson Education, London. https://oro.open.ac.uk/50104/
Mayer, R. E. (2020). Multimedia learning. Cambridge University Press.
Nation, I. S. P. (2022). Learning vocabulary in another language (3rd ed.). Cambridge University Press.
Norman, D. (2004). Emotional design. New York, NY: Basic Books
Nurjanah A., Irma Nuraeni Salsabila, Azzahra, A., Riska Rahayu, & Marlina, N. (2024). Artificial Intelligence (AI) usage in today’s teaching and learning process: A Review. Syntax Idea, 6(3), 1517–1523. https://doi.org/10.46799/syntax-idea.v6i3.3126
Paivio, A. (1971). Imagery and verbal processes. Leonardo, 5(4), 359. https://doi.org/10.2307/1572599
Paivio, A. (1990). Mental representations: A dual coding approach / monograph. Oxford University Press.
Paivio, A. (1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology/Revue Canadienne de Psychologie, 45(3), 255–287. https://doi.org/10.1037/h0084295
Palmer, S. E., Schloss, K. B., & Sammartino, J. (2013). Visual aesthetics and human preference. Annual Review of Psychology, 64, 77-107.
Paribakht, S., & Wesche, M. (1997). Vocabulary enhancement activities and reading for meaning in second language vocabulary development. In J. Coady, & T.
Huckin (Eds.), Second language vocabulary acquisition: a rationale for pedagogy (pp. 147–200). Norwood, NJ: Ablex.
Pishghadam, R., Ebrahimi, S., & Derakhshan, A. (2021). Culturally relevant emotional intelligence: A key to effective EFL teaching. System, 103, 102646. https://doi.org/10.1016/j.system.2021.102646
Plass, J. L., & Jones, L. C. (2005). Multimedia learning in second language acquisition. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 467–488). Cambridge University Press. https://doi.org/10.1017/CBO9780511816819.030
Ponari, M., Norbury, C. F., Rotaru, A., Lenci, A., & Vigliocco, G. (2018). Learning abstract words and concepts: Insights from developmental language disorder. Philosophical Transactions of the Royal Society B: Biological Sciences, 373(1752), 20170140. https://doi.org/10.1098/rstb.2017.0140
Ponari, M., Norbury, C. F., & Vigliocco, G. (2020). The role of emotional valence in learning novel abstract concepts. Developmental Psychology, 56(10), 1855–1865. https://doi.org/10.1037/dev0001091
Sabatinelli, D., Bradley, M. M., Fitzsimmons, J. R., & Lang, P. J. (2005). Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance. NeuroImage, 24(4), 1265–1270. https://doi.org/10.1016/j.neuroimage.2004.12.015
Sadoski, M., & Paivio, A. (2013). Imagery and text: A dual coding theory of reading and writing. Routledge.
Seibert, P. S., & Ellis, H. C. (1991). Irrelevant thoughts, emotional mood states, and cognitive task performance. Memory & Cognition, 19, 507–513. doi:10.3758/BF03199574
Schmidt, R. W. (1988). The Role of consciousness in second language learning. The University of Hawaii At Manoa.
Schmitt, N. (2008). Instructed second language vocabulary learning. Language Teaching Research, 12(3), 329–363. https://doi.org/10.1177/1362168808089921
Schmitt, N. (2019). Understanding vocabulary acquisition, instruction, and assessment: A research agenda. Language Teaching, 52(2), 261-274. https://doi.org/10.1017/S0261444819000053.
Schupp, H. T., Flaisch, T., Stockburger, J., & Junghöfer, M. (2006). Emotion and attention: event-related brain potential studies. Progress in brain research, 156, 31–51. https://doi.org/10.1016/S0079-6123(06)56002-9
Selwyn, N. (2016). Is technology good for education? Malden, Ma.
Silvia, P. J., & Kashdan, T. B. (2009). Interesting things and curious people: Exploration and engagement as transient states and enduring strengths. Social and Personality Psychology Compass, 3(5), 785–797. https://doi.org/10.1111/j.1751-9004.2009.00210.x
Solati-Dehkordi, S. A., & Salehi, H. (2016). Impact of explicit vocabulary instruction on writing achievement of upper-intermediate efl learners. International Education Studies, 9(4), 141-154.
Steinberg, L. (2005). Cognitive and affective development in adolescence. Trends in Cognitive Sciences, 9(2), 69–74. https://doi.org/10.1016/j.tics.2004.12.005
Suárez, M. del M., Gilabert, R., & Moskvina, N. (2021). The mediating role of vocabulary size, working memory, attention and inhibition in early vocabulary
learning under different TV genres: An exploratory study. TESOL Journal, 12(4). https://doi.org/10.1002/tesj.637
Sulaeman, Syuhadak Syuhadak, & Insyirah Sulaeman. (2023). ChatGPT as a New Frontier in Arabic Education Technology. Al-Arabi Journal of Teaching Arabic as a Foreign Language, 7(1), 83–83. https://doi.org/10.17977/um056v7i1p83-105
Sweller, J. (2022). Cognitive load theory and educational technology. Educational Technology Research and Development, 70(1), 1-16. https://doi.org/10.1007/s11423-022-10081-4
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. Springer New York.
Teng, M. F. (2022). Incidental L2 vocabulary learning from viewing captioned videos: Effects of learner-related factors. System, 105, 102736. https://doi.org/10.1016/j.system.2022.102736
Tractinsky, N., Katz, A. S., & Ikar, D. (2000). What is beautiful is usable. Interacting with Computers, 13, 127–145. https://doi.org/10.1016/S0953- 5438(00)00031-X
Tsai, Y. L., & Tsai, C. C. (2018). Digital game-based second-language vocabulary learning and conditions of research designs: A meta-analysis study. Computers & Education, 125, 345–357. https://doi.org/10.1016/j.compedu.2018.06.020
Tyng, C. M., Amin, H. U., Saad, M. N. M., & Malik, A. S. (2017). The influences of emotion on learning and memory. Frontiers in Psychology, 8(1454). https://doi.org/10.3389/fpsyg.2017.01454
Vasbieva, D. G. (2023). On the use of modern digital technologies in teaching a foreign language at a university. Humanities and Social Sciences Bulletin of the Financial University, 13(2), 24–31. https://doi.org/10.26794/2226-7867-2023-13-c-24-31
Vashishth, T. K., Sharma, V., Sharma, K. K., Kumar, B., Chaudhary, S., & Rajneesh Panwar. (2024). AIoT in education transforming learning environments and educational technology. Advances in Computational Intelligence and Robotics Book Series, 72–107. https://doi.org/10.4018/979-8-3693-0993-3.ch004
Wang, Y., Liu, C., & Tu, Y.-F. (2023). AI-powered emotional adaptive learning systems: A meta-analysis. Computers & Education, 194, 104703. https://doi.org/10.1016/j.compedu.2022.104703
Wolfson, S., & Case, G. (2000). The effects of sound and color on responses to a computer game. Interacting with Computers, 13, 183–192. doi:10.1016/S0953-5438(00)00037-0
Zarei, A. A., & Salimi, A. (2021). The comparative effects of song, picture and the keyword method on L2 vocabulary recognition and production. Applied Research in English, 1(1), 43–56.
