Development and Validation of an Integrated Knowledge Questionnaire: A Quantitative Investigation
Subject Areas : All areas of language and translation
Farzaneh Rahimzadeh
1
,
Ahmad Mohseni
2
,
Ghafour Rezaie
3
1 - Department of English, Science and Research Branch, Islamic Azad University, Tehran, Iran
2 - Islamic Azad University, South Tehran Branch
3 - Department of English, Garmsar Branch, Islamic Azad University, Garmsar, Iran
Keywords: Keywords: Assessment, Confirmatory Factor Analysis, Integrated Knowledge Questionnaire, Quantitative Study, Teacher&rsquo, s Knowledge,
Abstract :
Abstract: Integrating technology into instructional designs is currently a growing topic in higher education. This study sheds light on the integration of technology and KARDS factors. The researcher designed the integrated version of the teachers’ knowledge questionnaire to provide a more comprehensive understanding of teacher’s knowledge. This study aimed to develop and validate a Teachers’ Integrated Knowledge Questionnaire (TIKQ) through a quantitative investigation. The researcher aimed to assess individuals’ integrated knowledge in a specific domain. This research involved multiple stages: item generation, pilot testing, and statistical analysis. The researcher generated a pool of potential items for the TIKQ. These items covered various aspects of integrated knowledge within the chosen domain. The questionnaire was piloted and administered to 461 teachers in the second segment, which included 58 items. To determine if the trait structure of the teachers’ integrated knowledge questionnaire enjoys a good fit, statistical analysis techniques such as factor analysis and confirmatory factor analysis (CFA) were conducted. Cronbach’s alpha reliability and structural equation modeling were used to measure the internal consistency reliability of the teachers’ Integrated Knowledge Questionnaire (TIKQ). The new version of the integrated knowledge scale will assist teacher trainers in assessment of teacher’s knowledge. The findings from this study will contribute to developing an effective tool for measuring integrated knowledge in a specific domain. The tool can be used in various contexts, such as educational settings, research studies, and professional assessments.
Ahmadian, M. J., Ketabi, S., & Brown, C. M. (2020). The language assessment knowledge questionnaire (LAKQ): Assessing language teachers’ assessment literacy. Language Testing in Asia, 10(1), 1-21.
Angeli, C., & Valanides, N. (2009). Epistemological and methodological issues for conceptualizing, developing, and assessing ICT-TPACK: Advances in technological pedagogical content knowledge (TPACK). Computer & Education, 52(1), 154-168. https://doi.org/10.1016/j.compedu.2008.07.006
Aydın, E. & Mıhladız Turhan, G. (2023). Exploring primary school teachers’ pedagogical content knowledge in science classes based on PCK model. Journal of Pedagogical Research, 7(3), 70-99. https://doi.org/10.33902/JPR.202318964
Blömeke, S., Jentsch, A., Ross, N., Kaiser, G., and König, J. (2022). Opening up the black box: teacher competence, instructional quality, and students’ learning progress. Learning and Instruction, 79 (1). 101600. https://doi.org/10.1016/j.learninstruc.2022.101600
Ball, D. L., & Bass, H. (2000). Interweaving content and pedagogy in teaching and learning to teach: Knowing and using mathematics. In J. Boaler (Ed.), Multiple perspectives on teaching and learning mathematics (pp. 83–104). Westport, CT: Ablex.
Ball, D.L., Thames, M.H., & Phelps, G. (2008). Content knowledge for teaching: What makes it special? Journal of Teacher Education, 59(5), 389-407.
Bae, J., & Bachman, L. F. (2010). An investigation of four writing traits and two tasks across two languages. Language Testing, 27(2), 213-234. https://doi.org/10.1177/0265532209349470
Baran, E., & Uygun, E. (2016). Putting technological, pedagogical, and content (TPACK) in action: An integrated TPACK-design-based learning (DBL) approach. Australasian Journal of Educational Technology, 32(2), 47-63. https://doi.org/10.14742/ajet.2551
Blaschke, M. (2012). Heutagogy and lifelong learning: A Review of heutagogical practice and self-determined learning.The International Review of Research in Open and Distance Learning, 13(1), 56-71.https://doi.org/10.19173/irrodl.v13i1.1076
Baser, D., Kopcha, T. J., & Ozden, M. Y. (2016). Developing a technological pedagogical content knowledge (TPACK) assessment for preservice teachers learning to teach English as a foreign language. Computer Assisted Language Learning, 29 (4), 749-764. https://doi.org/10.1080/09588221.2015.1047456
Bostancıoğlu, A., & Handley, Z. (2018). Developing and validating a questionnaire for evaluating the EFL' Total PACKage': Technological Pedagogical Content Knowledge (TPACK) for English as a Foreign Language (EFL). Computer Assisted Language Learning, 31 (5-6), 572-598. https://doi.org/10.1080/09588221.2017.1422524
Brown, E., & Davis, L. (2018). Understanding the influence of context on teachers’ beliefs and practices. Teaching and Teacher Education, 73, 145-155.
Brown, E., & Johnson, S. (2016). The impact of teacher actions on student learning. Journal of Educational Psychology, 108(3), 345-360.
Carrier, S. I., & Moulds, L. D. (2003). Pedagogy, andragogy, and cybergogy: exploring best - practice paradigm for online teaching and learning. Sloan –C 9th International Conference on Asynchronous Learning Networks (ALN), USA PPT
Chadha, N. K. (2009). Applied Psychometry. Sage Publications.
Chapnick, S. &Meloy, J. (2005). From Andragogy to Heutagogy: Renaissance e-learning: creating dramatic and unconventional learning experiences. Essential resources for training and HR professionals. John Wiley and Sons.
Chen, P. S., & Hsu, Y. C. (2020). Developing and validating a technology pedagogical and content knowledge questionnaire for language teachers. Assessing Writing, 45, 1-17
De Haan. Baran, E., & Uygun, E. (2016). Putting technological, pedagogical, and content knowledge (TPACK) in action: An integrated TPACK-design-based learning (DBL) approach. Australasian Journal of Educational Technology, 32(2), 47-63. https://doi.org/10.14742/ajet.255
Duong, P. N., Voordeckers, W., Huybrechts, J., & Lambrechts, F. (2022). On external knowledge sources and innovation performance: Family versus non-family firms. Technovation, 114, 102448.https://doi.org/10.1016/j.technovation.2021.10244
Faramarzi, S., Heidari Tabrizi, H., & Chalak, A. (2019). Telegram: an instant messaging application to assist distance language learning. Teaching English with Technology, 12(1), 1263-1280. https://doi.org/10.29333/iji.2019.12181a
Fennema, E., & Franke, M. (1992). Teachers’ knowledge and its impact. In D. A. Grouws (Ed.), Handbook of research on mathematics teaching and learning (pp.147-164). Simon & Schuster Macmillan.
George, D., & Mallery, P. (2020). IBM SPSS statistics 26 step by step: A simple guide and reference. Routledge.
Goldberg, M. (2012). Arts integration: Teaching subject matter through the arts in multicultural settings (4th ed.). Pearson.
Graham, C. R., Burgoyne, N., Cantrell, P., Smith, L., St. Clair, L., & Harris, R. (2009). TPACK development in science teaching: Measuring the TPACK confidence of in-service science teachers. TechTrends, 53(5), 70-79.
Guerriero, S. (2014). Teachers’ pedagogical knowledge and the teaching profession: Background report and project Objectives. OECD.
Hase, S., & Kanyon, C. (2013). Self-determined learning: Heutagogy in action. Bloomsbury.
Hassani, V., Khatib, M., YazdaniMoghaddam, M. (2019). An Investigation of Teachers’ Perceptions of KARDS in an EFL Context. International Journal of Foreign Language Teaching and Research,7(28), 135-153.
Hill, H. C., Ball, D. L., & Schilling, S. G. (2008). Unpacking pedagogical content knowledge: Conceptualizing and measuring teachers’ topic-specific knowledge of students. Journal for Research in Mathematics Education, 39(4), 372-400.
Hofer, M. & Harris, J. (2010). Differentiating TPACK development: Using learning activity types with in-service and preservice teachers. In C. D. Maddux, D. Gibson, & B. Dodge (Eds.). Research highlights in technology and teacher education (pp. 295-302). Chesapeake, VA: Society for Information Technology and Teacher Education (SITE)
Hudson, B., & Zgaga, P. (2017). History, context, and overview: Implications for teacher education policy, practice, and future research. In B. Hudson (Ed.), Overcoming fragmentation in teacher education policy and practice (pp. 1–26). Cambridge University Press.
Jones, B., & Brown, C. (2019). Exploring the relationship between critical analysis and teacher effectiveness. Teaching and Learning Studies, 18(3), 245-260.
Johnson, S., & Smith, M. (2017). Contextual factors in instructional decision-making: Comparing urban and rural teachers. Urban Education, 52(8), 983-1009.
Kaiser, G., & König, J. (2019). Evaluating the outcome of teacher education at different points in time. Journal of Teacher Education, 70(4), 393-406
Kazutoshi, T., & Ever, M. B. (1999). Ergonagy: Its Relation to Andragogy. Paper presented at the Annual Meeting of the Comparative and International Education Society. Toronto: Canada (April 14-18). (ERIC Document Reproduction Service No. ED438464).
Kirschner, F., Paas, F., & Kester, L. (2018). Thematic review of studies in the field of teachers' practical knowledge. Educational Research Review, 23, 75-89.
König, J., Hanke, P., Glutsch, N. et al. (2022). Teachers’ professional knowledge for teaching early literacy: conceptualization, measurement, and validation. Educ Asse Eval Acc, 34, 483–507. https://doi.org/10.1007/s11092-022-09393-z
Korkmaz, M. V. N., Goksuluk, D., & Zararsiz, G. (2019). An R package for assessing multivariate normality. Department of Biostatistics, Hacettepe University, Ankara, Turki
Kumaravadivelu, B. (2012). Language teacher education for a global society. Taylor & Francis.
Kurt, G., & Atay, D. (2021). Development and validation of a Content and Language Integrated Learning (CLIL) knowledge questionnaire for language teachers. Language Teaching Research, 25(2), 249-273.
Kyriazos, T. A., & Stalikas, A. (2018). Applied psychometrics: The steps of scale development and standardization process. Psychology, 9, 2531-2560. https://doi.org/10.4236/psych.2018.911145
Lehmann, T. (2020). International perspectives on knowledge integration: Theory, research, and good practice in preservice teacher and higher education. Brill Sense. https://doi.org/10.1163/9789004429499.
Lim, P. S., Din. W. A., Nik Mohamed, N. Z., & Swanto, S. (2022). Development and validation of a survey questionnaire assessing technological pedagogical content knowledge and E-Learning acceptance for Malaysian English teachers. International Journal of Education, Psychology and Counseling, 7 (48), 206-220. doi: 10.35631/IJEPC.748015
Liu, S. Y., & Shulman, L. S. (2007). Validating measures of teachers’ knowledge of statistics: The use of and interpretation of reliability coefficients. Journal of Educational Measurement, 44(1), 47-62.
Lee, S., Kim, H., & Park, S. (2017). Evaluating teachers integrated pedagogical content knowledge: Development and validation of a questionnaire. Journal of Education and Training Studies, 5(1), 47-65.
Lee, J., & Smith, M. K. (2018). Teacher responsiveness and student engagement: A multilevel analysis. Journal of Educational Research, 111(4), 501-514.
Lee, J., & Turner, J. E. (2017). Extensive knowledge integration strategies in preservice teachers: The role of perceived instrumentality, motivation, and self-regulation. Educational Studies, 5(44), 505-520. https://doi.org/10.1080/03055698.2017.1382327
Lewin, A. Y., Massini, S., & Peeters, C. (2011). Microfoundations of internal and external absorptive capacity routines. Organization Science, 22(1), 1343-1371.
Li, S., Liu, Y., & Su, Y. (2022). Differential analysis of teachers’ technological pedagogical content knowledge (TPACK) abilities according to teaching stages and educational levels. Sustainability, 14(12), 1-15. https://doi.org/10.3390/su14127176
Lieberei, T., Welter, VDE., Großmann, L., & Krell, M. (2023). Findings from the expert-novice paradigm on differential response behavior among multiple-choice items of a pedagogical content knowledge test – implications for test development. Front. Psychol, 14, 1-17. doi: 10.3389/fpsyg.2023.1240120
Nafiyan, A. A. (2020). Language teachers’ perceptions of continuing professional development (CPD) opportunities: Development and validation of a questionnaire. Teaching English with Technology, 20(1), 85-103.
Nguyen, L.A.T., Habók, A. (2023). Tools for assessing teacher digital literacy: a review. Journal of Computers in Education. 1-42.
Onyefulu, C. and Abayomi, W.O. (2023). Student teachers’ knowledge and conceptions of classroom assessment at a university in Jamaica. Open Access Library Journal, 10, 1-19. doi: 10.4236/oalib.1110640.
Park, S., Choe, Y., & Johnson, J. F. (2020). Teach for America teachers’ pathway to common instructional language for literacy teaching. Teachers College Record, 122(6), 1-43
Rehhali, M., Mazouak, A., & Belaaouad, S. (2022). The Digital assessment of learning: Current situation and perspectives: Case of teachers of life and earth sciences. Journal of Information Technology Management, 14(3), 65-78. doi: 10.22059/jitm.2022.87534
Sahin, I. (2011). Development of survey of technological pedagogical and content knowledge (TPACK). Turkish Online Journal of Educational Technology,10(1), 97-105.
Schmidt, D. A., Baran, E., Thompson, A. D., Mishra, P., Koehler, M. J., & Shin, T. S. (2009). Technological Pedagogical Content Knowledge (TPACK): The Development and Validation of an Assessment Instrument for Preservice Teachers, JRTE, 42(2), 123-149.
Sherin, M. G., & ES, V. (2002). Learning to notice: scaffolding new teachers’ interpretations classroom interactions. Journal of Technology and Teacher Education, 10(4), 571-596.
Sherin, M. G. (2007). The development of teachers’ professional vision in video clubs. In Video research in the learning sciences (pp. 383-395). Erlbaum.
Shulman, L. S. (1986). Paradigms and research programs in the study of teaching. A contemporary perspective. In M. Wittrock (Ed.), Handbook of research on teaching (3rded.). Macmillan.
Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1), 1-22.
Smith, A. (2018). The impact of reflective practices on teacher development. Journal of Education, 42(2), 123-145.
Steele, M. D., & Hillen, A. F. (2012). The content-focused methods course: A model for integrating pedagogy and mathematics content. Mathematics TeacheR Educator, 1(1), 53-70. https://doi.org/10.5951/mathteaceduc.1.1.0053
Stoten, D.W. (2022). Navigating heutagogic learning: mapping the learning journey in management education through the OEPA model. Journal of Research in Innovative Teaching & Learning, 15 (1), 83-97. https://doi.org/10.1108/JRIT-07-2020-0038
Timur, B., & Tasar, M. F. (2011). In-service science teachers’ technological pedagogical content knowledge confidences and views about technology-rich environments. CEPS Journal, 1(4), 11-25. - DOI: 10.25656/01:6057
Van Driel, J. H., & Berry, A. (2012). Teacher professional development focusing on pedagogical content knowledge. Educational Researcher, 41(1), 26-28. https://doi.org/10.3102/0013189X11431010
Vongkulluksn, K., Xie, K., & Bowman, M. (2018). Revisit, redefine, and embrace the technology pedagogical content knowledge (TPACK) framework: Examining theoretical and empirical advancements. Australasian Journal of Educational Technology, 34(1), 1-14.
Yılmaz, E. (2020). Integrated knowledge: A comprehensive framework for understanding and enhancing the quality of education. Educational Sciences: Theory and Practice, 20(4), 1-19.
You, J. (2020). Technological pedagogical content knowledge for computer-assisted language learning: Validating a questionnaire for English as a foreign language teacher. Computers & Education, 157, 1-15.
Zhu, X., Raquel, M., & Aryadoust, V. (2019). Structural equation modeling to predict performance in English proficiency tests. In Quantitative Data Analysis for Language Assessment Volume II (pp. 101-126). Routledge.
