Convergent and Divergent Validity of Teachers’ Sense of Efficacy Scale: A Multitrait Multimethod Matrix Approach
Keywords:
Convergent Validity, Discriminating validity, construct validity, MTMM, TSESAbstract
There are two types of evidence that can be used to determine the degree to which an instrument measure a particular construct are convergent validity and discriminant validity. Convergent and discriminant validity evidence can be assessed systematically and quantitatively using the Multitrait-Multimethod (MTMM) matrix approach proposed by Campbell and Fisk (1959). A multitrait multimethod (MTMM) matrix approach was used to investigate the convergent and discriminating validity of the Teacher Sense of Efficacy Scale (TSES). Results indicated that partial convergent validity is established for the three constructs TSES instrument using the MTMM approach. This paper demonstrates the convergent validity procedure using the MTMM approach which can be useful tool for many potential authors for Journal of Quantitative Methods and for other researchers of various fields whose primary focus of research is instrument development and validation.
References
Al-Alwan, A., & Mahasneh, A. (2014). Teachers’ self-efficacy as determinant of students’ attitudes toward school: A study at the school level. Review of European Studies, 6(1), 171-179. doi:10.5539/res.v6n1p171
Al-Khalaileh, H. & Abu-Tineh, A. (2011). Self-efficacy of teachers in Zarqa governorate and its relation to their principals' leadership practices. Dirasat Journal, 38(2), 222-237.
Alwin, D.F. (2011). Evaluating the Reliability and Validity of Survey Interview Data Using the MTMM Approach. In Question Evaluation Methods (eds W.A. Shewhart, S.S. Wilks, J. Madans, K. Miller, A. Maitland and G. Willis). https://doi.org/10.1002/9781118037003.ch17
Baig, L., Violato, C., & Crutcher, R. (2010). A construct validity study of clinical competence: a multitrait multimethod matrix approach. The Journal of continuing education in the health professions, 30(1), 19–25. https://doi.org/10.1002/chp.20052
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2nd ed.). New York: The Guilford Press.
Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/Windows: Basic concepts, applications, and programming. Thousand Oaks: Sage Publications.
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. doi: 10.1037/h0046016.
Çapa, Y., Çakıroğlu, J., & Sarıkaya, H. (2005). The development and validation of a Turkish version of teachers’ sense of efficacy scale. Eğitim ve Bilim (Education and Science), 30(137), 74-81.
Courvoisier, D. S., Nussbeck, F. W., Eid, M., Geiser, C., & Cole, D. A. (2008). Analyzing the Convergent and Discriminant Validity of States and Traits: Development and Applications of Multimethod Latent State-Trait Models. Psychological Assessment, 20, 270-280. https://doi.org/10.1037/a0012812
De Stercke, J., Temperman, G., De Lièvre, B., & Lacocque, J. (2014). Echelle de sentiment d’efficacité personnelle des enseignants : Traduction francophone de la Teachers’ Sense of Efficacy Scale. Service de Pédagogie Générale et des Médias Educatifs, Université de Mons. Retrieved on December 25, 2015 from https://hal.archives-ouvertes.fr/hal-01145411/file/De_Sterckeetal-EchelleSEPEnseignants(tradTSES).pdf
Fives, H., & Buehl, M. M. (2010). Examining the factor structure of the Teachers’ Sense of Efficacy Scale. The Journal of Experimental Education, 78(1), 118-134. doi:10.1080/00220970903224461.
Furr, R. M. (2011). Scale Construction and Psychometrics for Social and Personality Psychology. New Delhi, IN: Sage Publications. https://doi.org/10.4135/9781446287866
Gibson, S., & Dembo, M. H. (1984). Teacher efficacy: A construct validation. Journal of Educational Psychology, 76(4), 569-582. doi:10.1037/0022-0663.76.4.569
Guerreiro-Casanova, D.C. & Azzi, R.G. (2013). Efficacy beliefs and teachers’ job satisfaction: A Brazilian study. In: 35th International School Psychology Conference. Universidade do Porto, Porto, Portugal, 2013b.
Haller, E. J., & Kleine, P. F. (2001). Using educational research: A school administrator's guide. New York: Longman.
Hamdani, M. R., Valcea, S., & Buckley, M. R. (2016). The MTMM matrix approach: Implications for HRM research. Personnel Review, 45(6), 1156–1175. https://doi.org/10.1108/PR-12-2014-0278
Hamdani, M., Vâlcea, S., & Buckley, M. (2016). The MTMM matrix approach: implications for HRM research. Personnel Review, 45, 1156-1175.
Hoyle, R. H. (1995). Structural equation modeling: Concepts, issues, and applications. Thousand Oaks: Sage Publications.
Klassen, R. M., & Chiu, M. M. (2010). Effects on teachers' self-efficacy and job satisfaction: Teacher gender, years of experience, and job stress. Journal of Educational Psychology, 102(3), 741.
Klassen, R. M., Bong, M., Usher, E. L., Chong, W. H., Huan, V. S., Wong, I. F., & Georgiou, T. (2009). Exploring the validity of a teachers' self-efficacy scale in five countries. Contemporary Educational Psychology, 34(1), 67-76. doi:10.1016/j.cedpsych.2008.08.001
Koch T., Holtmann J., Bohn J., Eid M. (2020). Multitrait-Multimethod Analysis. In: Zeigler-Hill V., Shackelford T.K. (eds) Encyclopedia of Personality and Individual Differences. Springer, Cham. https://doi.org/10.1007/978-3-319-24612-3_1331
Koch, T., Eid, M., & Lochner, K. (2018). Multitrait-Multimethod-Analysis: The Psychometric Foundation of CFA-MTMM Models. In P. Irwing, T. Booth, & D. J. Hughes (Eds.), The Wiley Handbook of Psychometric Testing: A Multidisciplinary Reference on Survey, Scale and Test Development (VII, pp. 781-846). Hoboken, NJ: Wiley.
Kyriazos, T. (2018) Applied Psychometrics: The Application of CFA to Multitrait-Multimethod Matrices (CFA-MTMM). Psychology, 9, 2625-2648. doi: 10.4236/psych.2018.912150.
Maas, C. M., Lensvelt-Mulders, G. M., & Hox, J. J. (2009). A multilevel multitrait-multimethod analysis. Methodology 5(3), 72-77. doi:10.1027/1614-2241.5.3.72
Martin, N. K., & Sass, D. A. (2010). Construct validation of the behavior and instructional management scale. Teaching and Teacher Education: An International Journal of Research and Studies, 26(5), 1124-1135.
Mundfrom, D. J., Shaw, D. G., & Tian Lu, K. (2005). Minimum sample size recommendations for conducting factor analyses. International Journal of Testing, 5(2), 159-168. doi:10.1207/s15327574ijt0502_4
Nie, Y., Lau, S., & Liau, A. (2012). The teacher efficacy scale: A reliability and validity study. The Asia-Pacific Education Researcher, 21(2), 414-421.
Nie, Y., Lau, S., & Liau, A. (2012). The teacher efficacy scale: A reliability and validity study. The Asia-Pacific Education Researcher, 21(2), 414-421.
Price, L. R. (2017). Psychometric Methods: Theory into Practice. New York: The Guilford Press.
Raykov, T. (2011). Evaluation of convergent and discriminant validity with multitrait-multimethod correlations. The British Journal of Mathematical and Statistical Psychology, 64(1), 38-52. doi:10.1348/000711009X478616
Ruan, J., Nie, Y., Hong, J., Monobe, G., Zheng, G., Kambara, H., & You, S. (2015). Cross-cultural validation of teachers' sense of efficacy scale in three Asian countries: Test of measurement invariance. Journal of Psychoeducational Assessment, 33(8), 769-779. doi:10.1177/073428291557402
Skaalvik, E. M., & Skaalvik, S. (2007). Dimensions of teacher self-efficacy and relations with strain factors, perceived collective teacher efficacy, and teacher burnout. Journal of Educational Psychology, 99(3), 611-625. doi:10.1037/0022-0663.99.3.611
Trochim, W. M. (2002). Research Methods Knowledge Base. Ithaca, NY: Cornell University.
Tschannen-Moran, M. (n.d.). Research Tools - Megan Tschannen-Moran's Web Site. Retrieved June 7, 2015, from http://wmpeople.wm.edu/index.php/site/page/mxtsch/researchtools
Tschannen-Moran, M., & Woolfolk Hoy, A. W. (2001). Teacher efficacy: Capturing an elusive construct. Teaching and Teacher Education, 17(7), 783-805. doi:10.1016/S0742-051X(01)00036-1
Tsigilis, N., Grammatikopoulos, V., & Koustelios, A. (2007). Applicability of the Teachers' Sense of Efficacy Scale to educators teaching innovative programs. International Journal of Educational Management, 21(7), 634 – 642.
Wasserman, J. D., & Bracken, B. A. (2003). Psychometric characteristics of assessment procedures. In I. B. Weiner (Ed.), Handbook of psychology (Vol. 10). Hoboken, NJ: John Wiley & Sons.
William, T. (2006, October 20). The multitrait-multimethod matrix. Retrieved December 14, 2015, from http://www.socialresearchmethods.net/kb/mtmmmat.php
Yang, S., Hinkle, J. C., Wyckoff, L.A. (2018). Using Multitrait-Multimethod (MTMM) Techniques to Examine the Convergent and Discriminant Validity of Social Disorder. Journal of Research in Crime and Delinquency, 55(5) 571-608, https://doi.org/10.1177/0022427818771109
