A Qualitative Study of Language Assessment Literacy of Iranian EFL Teachers with TEFL and Non-TEFL Background and Challenges in Their Students’ Assessment
محورهای موضوعی : نشریه زبان و ترجمه
kaveh Jalilzadeh
1
(English Department, Science and Research Branch, Islamic Azad University, Tehran, Iran)
Sayyed Mohammad Alavi
2
(Professor, English Department, University of Tehran, Tehran, Iran)
Masood Siyyari
3
(English Department, Science and Research Branch, Islamic Azad University, Tehran, Iran)
کلید واژه: Assessment Literacy, Components of Assessment Literacy, Novice and Experienced Teachers, TEFL/Non-TEFL Background,
چکیده مقاله :
The present study was an attempt to investigate language assessment literacy among EFL teachers inthe Iranian context aiming at studying the implications of assessment literacy for TEFL teacher educationreform. For this purpose, 20 EFL teachers in Iranian language institutes (Bayan, Azmoon, Zaban Sara,and Marefat institutes) were randomly picked for an extensive semi-structured examination. All themeetings were categorized and transcribed and after being analyzed, they were recorded on a DigitalVoice Recorder (DVR). The results revealed that Iranian instructors were found well-acquainted withassessment literacy components. Likewise, it turned out that novice teachers with a TEFL backgroundwere more aware of assessment literacy and its significance in teacher education. However, in termsof other assessment components such as test administration, selecting the best assessment methods,and communicating assessment results experienced teachers with a TEFL background presented moreto-the-point concepts compared to their counterparts in the non-TEFL group, indicating that theteachers with a TEFL background could perceive the aforementioned teacher assessment literacycomponents better than their non-TEFL counterpart. The findings imply that EFL language instituteinstructors` literacy in educational assessment particularly in especially in communicating assessmentresults to others and valid grading of the learners’ assessment is found insufficient.
پژوهش حاضر تلاشی برای بررسی سواد ارزشیابی زبان در بین معلمان زبان خارجی انگلیسی در بافت ایرانی با هدف بررسی دلایل و مفاهیم سواد ارزیابی برای اصلاح آموزش معلمان زبان خارجی انگلیسی بود. بدین منظور 20 نفر از مدرسین زبان انگلیسی در موسسات زبان ایران (موسسه های بیان، آزمون، زبان سرا و معرفت) به صورت تصادفی برای مصاحبه عمقی نیمه ساختاریافته انتخاب شدند. مصاحبه ها بر روی یک دستگاه ضبط صوت دیجیتال (DVR) ضبط و رونویسی، دسته بندی و تجزیه و تحلیل شدند. نتایج نشان داد که معلمان ایرانی با مولفه های سواد ارزیابی آشنایی نسبی داشتند. به همین ترتیب، مشخص شد که معلمان تازه کار با پیشینه تدریس زبان خارجی انگلیسی، از آگاهی بیشتری در ارتباط با سواد ارزشیابی و اهمیت آن در آموزش معلمان برخوردار بودند. با این حال، از نظر سایر مؤلفه‌های ارزشیابی مانند اجرای آزمون، انتخاب بهترین روش‌های ارزشیابی، و اطلاع رسانی نتایج ارزیابی، معلمان با تجربه با پیشینه آموزش زبان خارجی انگلیسی، مفاهیم اصلی را در مقایسه با همتایان خود در گروه غیر آموزش زبان خارجی انگلیسی ارائه نمودند که نشان می‌دهد معلمان با پیشینه تدریس زبان خارجی انگلیسی می توانند مؤلفه های سواد ارزیابی معلم فوق الذکر را بهتر از همتایان فاقد پیشینه آموزش زبان خارجی انگلیسی خود، درک نمایند. یافته‌ها حاکی از آن است که سواد معلمان مؤسسه زبان خارجی انگلیسی در ارزشیابی آموزشی، به ویژه در انتقال نتایج ارزیابی به دیگران و نمره‌دهی معتبر ارزشیابی زبان‌آموز، ناکافی است
Amiri, M., & Birjandi, P. (2015). Reliability and content validity of a comprehensive discourse completion test of interlanguage pragmatics for academic situations. Sino-US English Teaching, 12(9), 654-659.
Arani, A. M., Kakia, M. L., & Karimi, M. V. (2012). Assessment in education in Iran. Assessment, 9(2), 101-110.
Ashraf, H., & Zolfaghari, S. (2018). EFL teachers' assessment literacy and their reflective teaching. International Journal of Instruction, 11(1), 425-436.
Atay, D. (2008). Teacher research for professional development. ELT journal, 62(2), 139-147.
Azadi, A. (2018). A study on the conceptual factors of teacher assessment literacy among ESP instructors. Unpublished master’s thesis, Islamic Azad University, Electronic Branch, Tehran, Iran.
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice. Oxford: OUP.
Baniali, S. (2018). A study on Iranian experienced and novice EFL teachers’ belief and practice in teaching vocabulary. North Tehran Branch, Islamic Azad University. Tehran, Iran.
Barnes, N., Fives, H., & Dacey, C. M. (2015). Teachers’ beliefs about assessment. International handbook of research on teachers’ beliefs, 284-300.
Bayat, K., & Rezaei, A. (2015). Importance of teachers’ assessment literacy. International Journal of English Language Education, 3(1), 139-146.
Birjandi, P., & Tamjid, N. H. (2012). The role of self-, peer and teacher assessment in promoting Iranian EFL learners’ writing performance. Assessment & Evaluation in Higher Education, 37(5), 513-533.
Braden, J. P., Huai, N., White, J. L., & Elliot, S. N. (2005). Effective professional development to support inclusive large-scale assessment practices for all children. Assessment for Effective Intervention, 30(4), 63-71.
Braney, B. T. (2010). An examination of fourth grade teachers’ assessment literacy and its relationship to students’ reading achievement. Master thesis, East Carolina University, USA.
Brookhart, S.M. (2011). Educational assessment knowledge and skills for teachers. Educational Measurement: Issues and Practices, 30(1), 3-12.
Burry-Stock, J. A., & Frazier, C. H. (2008, March). Revision of the assessment practice inventory (APIR): A combined exploratory factor analysis and polytomous IRT approach. Paper Presented at the American Educational Research Association, New York, NY.
Chen, C. I. (2013). Examining psychometric dimensions of the Ages and Stages Questionnaires: Inventory: A cross-country comparison between Taiwan and the United States. Unpublished doctoral dissertation, Graduate School of the University of Oregon, Oregon, The U.S.A.
Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying second language teachers’ knowledge, beliefs, and practices. Assessing Writing, 28, 43-56.
Darling-Hammond, L. (2000). Teacher quality and student achievement: A review of state policy evidence. Education Policy Analysis Archives, 8(1), 20-32. Retrieved from http://epaa.asu.edu/epaa/vol8.html
DeLuca, C., & Klinger, D. A. (2010). Assessment literacy development: Identifying gaps in teacher candidates’ learning. Assessment in Education: Principles, Policy & Practice, 17(4), 419-438.
DeLuca, C., & Volante, L. (2016). Assessment for learning in teaching education programs: Navigating the juxtaposition theory and praxis. Journal of the International Society for Teacher Education, 20(1), 321-330.
Eckhout, T., Davis, S., Mickelson, K., & Goodburn, A. (2005). A method for providing assessment training to in-service and pre-service teachers. In Kr.D. Gutiérrez (Ed.), Annual meeting of the southwestern educational research association in New Orleans, LA (pp.121-132.). New York: Arnolds.
Edwards, F. (2017). A rubric to track the development of secondary pre-service and novice teachers’ summative assessment literacy. Assessment in Education: Principles, Policy & Practice, 24(2), 205-227.
Eezami, R. (2016). A study on work engagement and fulfillment of basic psychological needs among novice and experienced EFL teachers in the Iranian institutes. Kharazmi University, Tehran, Iran.
Ellis, R. (2008). The study of second language acquisition (2nd ed.). Oxford: OUP.
Eslami, Z. R., & Fatahi, A. (2008). Teachers' sense of self-efficacy, English proficiency, and instructional strategies: A study of nonnative EFL teachers in Iran. TESL-EJ, 11(4), 1-19.
Fard, Z. R., & Tabatabaei, O. (2018). Investigating assessment literacy of EFL teachers in Iran. Journal of Applied Linguistics and Language Research, 5(3), 91-100.
Farhady, H., & Hedayati, H. (2009).Language assessment policy in Iran. Annual Review of Applied Linguistics, 29,132-141.
Farhady, H., & Tavassoli, K. (2018). Developing a language assessment knowledge test for EFL teachers: A data-driven approach. Iranian Journal of Language Teaching Research, 6(3), 79-94.
Fathi, J., & Derakhshan, A. (2019). Teacher self-efficacy and emotional regulation as predictors of teaching stress: An investigation of Iranian English language teachers. Teaching English Language , 13(2), 117-143.
Fathi, J., & Saeedian, A. (2020). A Structural Model of Teacher Self-Efficacy, Resilience, and Burnout among Iranian EFL Teachers. Iranian Journal of English for Academic Purposes, 9(2), 14-28.
Firoozi, T., Razavipour, K., & Ahmadi, A. (2019). The language assessment literacy needs of Iranian EFL teachers with a focus on reformed assessment policies . Langu age Testing in Asia, 9(1), 2-14.
Gatbonton, E. (2008). Looking beyond teachers’ classroom behavior: Novice and experienced ESL teachers’ pedagogical knowledge. Language Teaching Research, 12(2), 161-182.
Hajizadeh, N., & Salahshour, N. (2014). Characteristics of effective EFL instructors: Language teachers’ perceptions versus learners’ perceptions. International Journal of Applied Linguistics and English Literature, 3(1), 202-214.
Inbar-Lourie, O. (2013). Language assessment literacy: What are the ingredients? Plenary speech at the 4th CBLA SIG Symposium Program ´Language Assessment Literacy- LAL, Cyprus. Published in the special issue on language assessment literacy. Language Testing, 30(3), 301-307.
James, M. (2008). Assessment and learning. Unlocking assessment: Understanding for reflection and application, 20-35.
Jannati, S. (2015). ELT teachers’ language assessment literacy: Perceptions and practices. The International Journal of Research in Teacher Education, 6(2), 26-37.
Jeong, H. (2013). Defining assessment literacy: Is it different for language testers and non-language testers?. Language Testing, 30(3), 345-362.
Khezerlou, E. (2017). Professional self-esteem as a predictor of teacher burnout across Iranian and Turkish EFL teachers. Iranian Journal of Language Teaching Research, 5(1), 113-130.
Khodabakhshzadeh, H., Kafi, Z., & Hosseinnia, M. (2018). Investigating EFL teachers' conceptions and literacy of formative assessment: Constructing and validating an inventory. International Journal of Instruction, 11(1), 139-152.
Lam, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 169-197.
Lam, R. (2019). Teacher assessment literacy: Surveying knowledge, conceptions and practices of classroom-based writing assessment in Hong Kong. System, 81, 78-89.
Lantolf, J. P., & Poehner, M. E. (2008). Dynamic assessment In E. Shohamy& N. Hornberger (Eds.), Encyclopedia of language and education (Vol. 7): Language testing and assessment (pp. 273-284). New York: Springer.
Looney, A., Cumming, J., van Der Kleij, F., & Harris, K. (2018). Re-conceptualizing the role of teachers as assessors: Teacher assessment identity. Assessment in Education: Principles, Policy & Practice, 25(5), 442-467.
Mackey, A., & Gass, S. M. (2016). Second language research: Methodology and design (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
McMillan, J. H. (2000). Fundamental assessment principles for teachers and school administrators. Practical Assessment, Research & Evaluation, 7(8), 1-9.
McNamara, T. (2003). Tearing us apart again: The paradigm wars and the search for validity. Eurosla Yearbook, 3(1), 229-238.
McTighe, J., & O’Connor, K. (2005). Seven practices for effective teaching. Educational Leadership, 63(3), 10-17.
Mellati, M., & Khademi, M. (2018). Exploring teachers’ assessment literacy: Impact on learners’ writing achievements and implications for teacher development. Australian Journal of Teacher Education, 43(6), 1-18.
Mertler, C. A. (1999). Assessing student performance: A descriptive study of the classroom assessment practices of Ohio teachers. Education, 120, 285-296.
Mertler, C. A. (2002). Classroom assessment literacy inventory. (Adapted from the Teacher Assessment Literacy Questionnaire (1993), by Barbara S. Plake & James C. Impara, University of Nebraska-Lincoln, in cooperation with The National Council on Measurement in Education & the W.K. Kellogg Foundation.
Mertler, C. A. (2005). Secondary teachers’ assessment literacy: Does classroom experience make a difference? American Secondary Education, 33(2), 76-92.
Mertler, C. A. (2009). Teachers’ assessment knowledge and their perceptions of the impact of classroom assessment professional development. Improving Schools, 12(1), 101-113.
Mohammadi, A. (2020), A mixed-methods study on the teacher assessment literacy of ELT instructors versus content instructors Islamic Azad University. Unpublished master’s thesis, University of Qom, Iran.
Plake, B. S., & Impara, J. C. (1993). Teacher assessment literacy questionnaire. Nebraska-Lincoln: The National Council on Measurement in Education & the W.K. Kellogg Foundation.
Pilcher, J. K. (2001). The standards and integrating instructional and assessment practices. ERIC (ED 451 190).
Popham, W. J. (2014). Classroom assessment: What teachers need to know (7th Ed.). Boston: Pearson Education.
Razavipour, K., Riazi, A., & Rashidi, N. (2011). On the interaction of test washback and teacher assessment literacy: The case of Iranian EFL secondary school teachers. English Language Teaching, 4(1), 156-161.
Rodríguez, A. G., & McKay, S. (2010). Professional development for experienced teachers working with adult English language learners. CAELA Network Brief. Center for Adult English Language Acquisition. Retrieved from www. cal.or g/caelanetwork
Roohani, A., & Dayeri, K. (2019). On the Relationship between Iranian EFL Teachers' Burnout and Motivation: A Mixed Methods Study. Iranian Journal of Language Teaching Research, 7(1), 77-99.
Sadeghi, K., & Khezrlou, S. (2014). Burnout among English language teachers in Iran: Do socio-demographic characteristics matter?. Procedia-Social and Behavioral Sciences, 98, 1590-1598.
Sanders, W., & Rivers, j. (1996). Cumulative and residual effects of teachers on future student academic achievement. Retrieved from: http://mdk 12.org/practices/ensure/tva/tva_2.html.
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Australia Language Testing, 30(3) 309-327.
Stiggins, R. (1991). Assessment literacy. Phi Delta Kappan, 72, 534-539.
Stiggins, R. (1999). Are you assessment literate? The LANGUAGE INSTITUTE Journal, 6(5), 20-23.
Stobart, G. (2008). Testing times: The uses and abuses of assessment. Oxon: Routledge.
Tajeddin, Z., Alemi, M., & Yasaei, H. (2018). Classroom assessment literacy for speaking: Exploring novice and experienced English language teachers' knowledge and practice. Iranian Journal of Language Teaching Research, 6(3), 57-77.
Tao, N. (2014). Development and validation of classroom assessment literacy scales: English as a Foreign Language (EFL) instructors in a Cambodian higher education setting. Unpublished doctoral dissertation, Victoria University, Canada.
Tavassoli, K., & Farhady, H. (2018). Assessment knowledge needs of EFL teachers. Teaching English Langu age, 12(2), 45-65.
Vitali, G. J. (1994). Factors influencing teacher’s practices in an assessment driven reform. ERIC Document (ED 373 053).
Walters, F. S. (2010). Cultivating assessment literacy: Standards evaluation through language-test specification reverse engineering. Language Assessment Quarterly, 7(4), 317-342.
Wang, J. R., Kao, H. L., & Lin, S. W. (2010). Pre-service teachers’ initial conceptions about assessment of science learning: The coherence with their views of learning science. Teaching and Teacher Education, 26(3), 522-529.
Wang, T., Wang, K., & Huang, S. (2008). Designing a web-based assessment environment for improving pre-service teacher assessment literacy. Computers & Education, 51, 448 462.
Xu, Y., & Brown, G. T. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149-162.
Zamani, R., & Ahangari, S. (2016). Characteristics of an effective English language teacher (EELT) as perceived by learners of English. International Journal of Foreign Language Teaching and Research, 4(14), 69-88.
