Adaptation and validation of the school climate measure among Polish-speaking adolescents

DOI: https://doi.org/10.35765/mjse.2025.1427.17
Keywords: school climate, scale development, self-report, psychometric tool, adolescents

Abstract

Research objectives (aims) and problem(s): The main objective of the present study was to assess the performance of a Polish adaptation of the School Climate Measure (SCM) among a sample of Polish adolescents (N = 451).

Research methods: Reliability analyses, confirmatory factor analysis, sex and cultural measurement invariance analyses, as well as convergent and discriminant validity analyses were performed using the adapted 10-domain version of the SCM.

Process of argumentation: The School Climate Measure (SCM; Zullig et al., 2015) was developed to assess middle and high school students’ subjective perceptions of their school climate.

Research findings and their impact on the development of educational sciences: The 10-factor model demonstrated acceptable fit: χ²(774) = 1428.73, p < .001, RMSEA = .052, 95% CI [.048, .056], CFI = .944, TLI = .938, SRMR = .053. We also achieved strict sex measurement invariance, allowing for valid comparisons between male and female students in Poland. However, comparisons with American samples should be made with caution, as only weak factorial cultural invariance was confirmed. Reliability indices for all scales were satisfactory: Cronbach’s α ≥ .81, Tarkkonen’s ρ ≥ .71, McDonald’s ω ≥ .81. The Polish version of the SCM demonstrated good convergent validity with students’ average grades and good discriminant validity, as evidenced by a lack of correlation between subscale scores and the time taken to complete the survey. The SCM can help identify challenges in Polish schools and support efforts to promote a positive school climate that promotes students’ holistic development and well-being.

Conclusions and/or recommendations: The Polish adaptation of the SCM is recommended for use with Polish adolescents for both research and practical applications.

References

Audas, R., & Willms, J. D. (2001). Engagement from dropping out of school: A life course perspective. Human Resources and Social Development Canada.

Bear, G. G., Gaskins, C., Blank, J., & Chen, F. F. (2011). Delaware School Climate Survey-Student: Its factor structure, concurrent validity, and reliability. Journal of School Psychology, 49(2), 157–174. https://doi.org/10.1016/j.jsp.2011.01.001

Bache, S. M., Wickham, H., Henry, L., & Henry, M. L. (2022). magrittr (R package version). https://cran.r-project.org/package=magrittr

Brand, S., Felner, R., Shim, M., Seitsinger, A., & Dumas, T. (2003). Middle school improvement and reform: Development and validation of a school-level assessment of climate, cultural pluralism, and school safety. Journal of Educational Psychology, 95(3), 570–588. https://doi.org/10.1037/0022-0663.95.3.570

Bronfenbrenner, U., & Morris, P. A. (1998). The ecology of developmental processes. In W. Damon & R. M. Lerner (Eds.), Handbook of child psychology: Theoretical models of human development (pp. 993–1028). John Wiley & Sons. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.466.7579&rep=rep1&type=pdf

Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.

Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005

Buchcic, E., & Grodzińska-Jurczak, M. (2004). Environmental education in Polish primary schools. International Research in Geographical & Environmental Education, 13(3), 264–268.

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5

Clark, K. N., Strissel, D., Demaray, M. K., Ogg, J., Eldridge, M. A., & Malecki, C. K. (2022, July 14). Victimization and depressive symptoms in early adolescence: The role of perceived school climate. School Psychology. Advance online publication. http://dx.doi.org/10.1037/spq0000511

Cohen, J., McCabe, E. M., Michelli, N. M., & Pickeral, T. (2009). School climate: Research, policy, practice, and teacher education. Teachers College Record, 111(1), 180–213. https://doi.org/10.1177/016146810911100108

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555

Daily, S. M., Zullig, K. J., Myers, E. M., Smith, M. L., Kristjansson, A. L., & Mann, M. J. (2018). Preliminary validation of the SCM in a sample of early adolescent public school children. Assessment for Effective Intervention. https://doi.org/10.1177/15345084188157

Daily, S. M., Mann, M. J., Kristjansson, A. L., Smith, M. L., & Zullig, K. J. (2019). School climate and academic achievement in middle and high school students. Journal of School Health, 89(3), 173–180.

Gonzálvez, C., Bacon, V., & Kearney, C. A. (2023). Systematic and evaluative review of school climate instruments for students, teachers, and parents. Psychology in the Schools, 60(6), 1781–1836. https://doi.org/10.1002/pits.22838

Gwiazdowska-Stańczak, S. (2021a). School engagement and school climate of students with high and low grade point averages. Kwartalnik Naukowy Fides Et Ratio, 48(4), 427–439. https://doi.org/10.34766/fetr.v48i4.974

Gwiazdowska-Stańczak, S. (2021b). Zaangażowanie w naukę i klimat w szkole [Engagement in learning and school climate]. Difin.

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis (7th ed.). Prentice-Hall.

Harrell, F., & Dupont, C. (2022). Hmisc: Harrell Miscellaneous (R package version 4.7-2). https://cran.r-project.org/web/packages/Hmisc/index.html

Henze, N., & Zirkler, B. (1990). A class of invariant consistent tests for multivariate normality. Communications in Statistics—Theory and Methods, 19, 3595–3617. https://doi.org/10.1080/03610929008830400

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118

Jakubowski, M. (2021). Poland: Polish education reforms and evidence from international assessments. In Improving a country’s education: PISA 2018 results in 10 countries (pp. 137–158).

Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., Rosseel, Y., Miller, P., Quick, C., & Garnier-Villarreal, M. (2022). semTools: Useful tools for structural equation modeling (R package version 0.5-6). https://CRAN.R-project.org/package=semTools

Kline, R. B. (2023). Principles and practice of structural equation modeling (5th ed.). The Guilford Press.

Laakasuo, M., Palomäki, J., Abuhamdeh, S., Lappi, O., & Cowley, B. U. (2022). Psychometric analysis of the flow short scale translated to Finnish. Scientific Reports, 12(1), 20067. https://doi.org/10.1038/s41598-022-24715-3

Lishinski, A. (2021). lavaanPlot: Path diagrams for ‘lavaan’ models via ‘DiagrammeR’ (R Package Version 0.6.2). https://cran.r-project.org/web/packages/lavaanPlot/index.html

Loukas, A., Suzuki, R., & Horton, K. D. (2006). Examining school connectedness as a mediator of school climate effects. Journal of Research on Adolescence, 16(3), 491–502. https://doi.org/10.1111/j.1532-7795.2006.00504.x

Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. https://doi.org/10.1093/biomet/57.3.519

McDonald, R. P. (1999). Test theory: A unified treatment. Psychology Press.

McGuire, J. K., Anderson, C. R., Toomey, R. B., & Russell, S. T. (2010). School climate for transgender youth: A mixed method investigation of student experiences and school responses. Journal of Youth and Adolescence, 39(10), 1175–1188.

Muthén, L. K., & Muthén, B. O. (2012). Mplus statistical software, 1998–2012. Los Angeles, CA: Muthén & Muthén.

Neuwirth, E. (2022). RColorBrewer: ColorBrewer palettes (R Package Version 1.1-3). Retrieved from https://cran.r-project.org/web/packages/RcolorBrewer/index.html

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.

Ocetkiewicz, I., Tomaszewska, B., & Mróz, A. (2017). Renewable energy in education for sustainable development. The Polish experience. Renewable and Sustainable Energy Reviews, 80, 92–97.

Peterson, B. G., Carl, P., Boudt, K., Bennett, R., Ulrich, J., Zivot, E., ... & Shea, J. M. (2020). PerformanceAnalytics: Econometric tools for performance and risk analysis (R Package Version 2.0.4). Retrieved from https://cran.r-project.org/web/packages/PerformanceAnalytics/index.html

Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004

Pya, N., Voinov, V., Makarov, R., & Voinov, Y. (2016). mvnTest: Goodness of fit tests for multivariate normality (R Package Version 1.1-0). Retrieved from https://cran.r-project.org/web/packages/mvnTest/index.html

Revelle, W. R. (2022). psych: Procedures for personality and psychological research (Version 2.2.9). Evanston: Northwestern University. Retrieved from https://CRAN.R-project.org/package=psych

Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate, student engagement, and academic achievement. Journal of Educational Psychology. Advance online publication. https://doi.org/10.1037/a0027268

Rutkowski, L., & Svetina, D. (2014). Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educational and Psychological Measurement, 74(1), 31–57. https://doi.org/10.1177/0013164413498257

Sointu, E. T., Savolainen, H., Lappalainen, K., & Lambert, M. C. (2017). Longitudinal associations of student–teacher relationships and behavioural and emotional strengths on academic achievement. Educational Psychology, 37(4), 457–467.

Vehkalahti, K., Puntanen, S., & Tarkkonen, L. (2006). Estimation of reliability: A better alternative for Cronbach's alpha. Helsinki: Department of Mathematics and Statistics, University of Helsinki.

Wei, T., & Simko, V. (2021). corrplot: Visualization of a correlation matrix (Version 0.92). Retrieved from https://github.com/taiyun/corrplot

Wickham, H., Miller, E., Smith, D., & RStudio. (2022a). haven: Import and export 'SPSS', 'Stata' and 'SAS' files (R Package Version 2.5.1). Retrieved from https://cran.r-project.org/web/packages/haven/index.html

Wickham, H., François, R., Henry, L., & Müller, K. (2022b). dplyr: A grammar of data manipulation. Retrieved from https://dplyr.tidyverse.org

Zullig, K. J., Collins, R., Ghani, N., Patton, J. M., Hunter, A. A., & Huebner, E. S. (2014). Preliminary development of a revised version of the School Climate Measure. Psychological Assessment, 27(3), 1072–1081. http://dx.doi.org/10.1037/pas0000070

Zullig, K. J., Collins, R., Ghani, N., Patton, J. M., Huebner, E. S., & Ajamie, J. (2014). Psychometric support of the School Climate Measure in a large, diverse sample of adolescents: A replication and extension. Journal of School Health, 41, 82–90.

Zullig, K. J., Collins, R., Ghani, N., Hunter, A. A., Patton, J. M., Huebner, E. S., & Zhang, J. (2015). Preliminary development of a revised version of the School Climate Measure. Psychological Assessment, 27(3), 1072–1081.

Zullig, K. J., Huebner, E. S., & Patton, J. M. (2011). Relationships among school climate domains and school satisfaction. Psychology in the Schools, 48(2), 133–145.

Zullig, K. J., Koopman, T. M., Patton, J. M., & Ubbes, V. A. (2010). School climate: Historical review, instrument development, and school assessment. Journal of Psychoeducational Assessment, 28, 139–152.

Zullig, K. J., Matthews-Ewald, M. R., & Huebner, E. S. (2021). An introduction to the School Climate Measure. AASA Journal of Scholarship & Practice, 18(1), 49+. Retrieved from https://link.gale.com/apps/doc/A671555131/AONE?u=anon~83550720&sid=googleScholar&xid=6821b9d3

Zullig, K. J., Ward, R. M., Huebner, E. S., & Dailey, S. M. (2018). Associations between adolescents’ school climate and perceived quality of life. Child Indicators Research, 11, 1737–1753.

Published
2025-06-27
How to Cite
Lachowska, B., Gwiazdowska-Stańczak, S., Wojtasiński, M., Tużnik, P., & Zullig, K. (2025). Adaptation and validation of the school climate measure among Polish-speaking adolescents. Multidisciplinary Journal of School Education, 14(1 (27), 365-389. https://doi.org/10.35765/mjse.2025.1427.17
Issue
Vol. 14 No. 1 (27) (2025): Socio-cultural inclusion/integration of migrant and refugee children at school
Section
Miscellaneous Articles

Copyright (c) 2025 Bogusława Lachowska, Sylwia Gwiazdowska-Stańczak, Marcin Wojtasiński, Przemysław Tużnik, Keith Zullig

Creative Commons License

This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.

  1. The Author/Authors declares/declare that their publication is original has not been published before and is not currently being considered for publication elsewhere and does not include borrowings from other works which might cause Publisher's responsibility, does not infringe the rights of the third party and that their copyright on this publication is not limited. The Author/Authors will incur all the costs and will pay compensations which might result from the mendacity of the following statement.

  2. The Author/Authors declares/declare that issues about publication ethics, have been appropriately considered.

  3. The Author/Authors agrees/agree to publish the article free of charge in Multidisciplinary Journal of School Education in English or Spanish. The Editorial Board reserves the right to shorten the texts and change the titles.

  4. As part of free publication mentioned in § 1, the Author/Authors agrees/agree to make the full electronic version of their article available in the Internet.

  5. The Author/Authors agrees/agree to index their article in databases at home and abroad, including abstracts and keywords as well as Authors’ affiliation in English and in other languages. The Author/Authors agrees/agree to pass on the information mentioned above to the owners of these databases.

  6. The Author/Authors declares/declare that the article is free of plagiarism.

  7. The Author/Authors declares/declare that funding and conflict of interest information has been included in the article.

  8. The Author/Authors accepts/accept that the author is aware of the consequences of scientific dishonesty, which, once detected, will be documented and disclosed to the public, and information about it will be communicated to the relevant institutions (universities employing the authors, scientific societies, publishing houses, etc.).

  9. The Author/Authors declares/declare to publish the text in the Multidisciplinary Journal of School Education under a Creative Commons Attribution-NoDerivatives 4.0 International License (CC BY-ND 4.0).

  10. For one Author. Please complete the Author Statement and send it to the editorial office. Please download, complete, scan and attach the file in the system during the submission process.
    Download: Author Statement

  11. For more than one Author. The Authors declare to bear complete responsibility for the scientific reliability of the article submitted. The detailed contribution of all co-authors is defined. Please complete the Authors Statement-Authorship Contributions and send it to the editorial office. Please indicate the specific contributions made by each author (list the authors’ initials, e.g., JKH).  Please download, complete, scan and attach the file in the system during the submission process. 
    Download: Authors Statement - Authorship Contributions