CoChat
Sign Up
Cited by 13Citizenship Education and DemocracyEducational Environments and Student OutcomesEducator Training and Historical Pedagogy

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Open Classroom Climate in International Large-Scale Assessments: Individual Construct or Climate Construct?

Open access
Myoung, Eunjung, Liou, Pey-Yan·2025·Sage Open
DOI 10.1177/21582440251323560
Open this paper in CoChat — free account

Abstract

This study examines the conceptualization and operationalization of the open classroom climate construct in existing empirical works. Open classroom climate is a classroom environment where adolescents can freely discuss political issues and express their opinions. The study reviewed 45 secondary data analysis articles that examined the open classroom climate construct from the Civic Education Study and the International Civic and Citizenship Education Study , the major international large-scale assessments. This review identified inconsistencies in how these studies define and analyze the open classroom climate construct. These inconsistencies arise from the different interpretations of the construct whether as an individual construct that reflects students’ distinctive perceptions or as a climate construct that represents a collective classroom experience. Due to varied conceptualizations, researchers employed different operationalization approaches, each incorporating distinct statistical methods. It led to varied results and impeded the development of a unified understanding of the concept. Our study emphasizes the necessity for a clear and consistent conceptualization of the open classroom climate construct for future works. It implores researchers to deliberate on the construct’s nature, endorsing a proper operationalization to understand open classroom climate aptly.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/21582440251323560

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 70

  1. Bäckman E., Trafford B. (2007). Democratic governance of schools (Vol. 383). Council of Europe.
  2. Bandura A. Caprara G. V. Barbaranelli C. Regalia C. Scabini E. (2011). Impact of family efficacy beliefs on quality of family functioning and satisfaction with family life. Applied Psychology 60(3) 421–448. https://doi.org/10.1111/j.1464-0597.2010.00442.x · DOI
  3. Barber C., Clark C., Torney-Purta J., Campbell D., Hahn C., Kuhn D. (2021). Learning environments and school/classroom climate as supports for civic reasoning, discourse, and engagement. In Lee C. D., White G., Dong D. (Eds.), Educating for civic reasoning and discourse (pp. 273–318). National Academy of Education.
  4. Barber C. Torney-Purta J. Wilkenfeld B. Ross J. (2015). Immigrant and native-born adolescents’ civic knowledge and attitudes in Sweden and the United States: Emergent citizenship within developmental niches. Research in Comparative and International Education 10(1) 23–47. https://doi.org/10.1177/1745499914567818 · DOI
  5. Barcikowski R. S. (1981). Statistical power with group mean as the unit of analysis. Journal of Educational Statistics 6(3) 267–285. https://doi.org/10.3102/10769986006003267 · DOI
  6. Bardach L. Oczlon S. Pietschnig J. Lüftenegger M. (2020). Has achievement goal theory been right? A meta-analysis of the relation between goal structures and personal achievement goals. Journal of Educational Psychology 112(6) 1197–1220. https://doi.org/10.1037/edu0000419 · DOI
  7. Bardach L. Yanagida T. Lüftenegger M. (2020). Studying classroom climate effects in the context of multi-level structural equation modelling: An application-focused theoretical discussion and empirical demonstration. International Journal of Research & Method in Education 43(4) 348–363. https://doi.org/10.1080/1743727X.2020.1791071 · DOI
  8. Berkowitz R. Iachini A. Moore H. Capp G. Astor R. A. Pitner R. Benbenishty R. (2017). School climate. In Noblit G. W. (Ed.) Oxford research encyclopedia of education. Oxford University Press https://doi.org/10.1093/acrefore/9780190264093.013.89 · DOI
  9. Blaskó Z. da Costa P. D. Vera-Toscano E. (2019). Non-cognitive civic outcomes: How can education contribute? European evidence from the ICCS 2016 study. International Journal of Educational Research 98 366–378. https://doi.org/10.1016/j.ijer.2019.07.005 · DOI
  10. Campbell D. E. (2008). Voice in the classroom: How an open classroom climate fosters political engagement among adolescents. Political Behavior 30(4) 437–454. https://doi.org/10.1007/s11109-008-9063-z · DOI
  11. Caro D. H. Schulz W. (2012). Ten hypotheses about tolerance toward minorities among Latin American adolescents. Citizenship Social and Economics Education 11(3) 213–234. https://doi.org/10.2304/csee.2012.11.3.213 · DOI
  12. Castillo J. C. Miranda D. Bonhomme M. Cox C. Bascopé M. (2015). Mitigating the political participation gap from the school: The roles of civic knowledge and classroom climate. Journal of Youth Studies 18(1) 16–35. https://doi.org/10.1080/13676261.2014.933199 · DOI
  13. Chae S. E. (2018). Asian adolescents’ attitudes toward equal rights: Determinants of adolescents’ attitudes toward equal rights in five Asian countries. The International Journal of Civic Political and Community Studies 16(3) 13–24. https://doi.org/10.18848/2327-0047/CGP/v16i03/13-24 · DOI
  14. Chan D. (2009). So why ask me? Are self-report data really that bad. In Charles E., Vandenberg R. J. (Eds.). Statistical and methodological myths and urban legends: Doctrine, verity and fable in organizational and social science (pp. 309–336). Routledge.
  15. Claes E. Maurissen L. Havermans N. (2017). Let’s talk politics: Which individual and classroom compositional characteristics matter in classroom discussions? YOUNG 25(4) 18–35. https://doi.org/10.1177/1103308816673264 · DOI
  16. Cronbach I. J. (1976). Research on classrooms and schools: Formulations of questions, design, and analysis. Stanford University Evaluation Consortium.
  17. Deimel D. Hahn-Laudenberg K. Ziemes J. F. Abs H. J. (2022). Civic education and social interactions at school as drivers of intended electoral participation: Similarities and differences in four European school systems. Education Citizenship and Social Justice 19(1) 37–57. https://doi.org/10.1177/17461979221114549 · DOI
  18. Deimel D. Hoskins B. Abs H. J. (2020). How do schools affect inequalities in political participation: Compensation of social disadvantage or provision of differential access? Educational Psychology 40(2) 146–166. https://doi.org/10.1080/01443410.2019.1645305 · DOI
  19. Feitosa F. (2020). Does civic education foster civic duty? A systematic cross-country analysis of the effect of three forms of civic education on the sense of civic duty to vote. Canadian Journal of Political Science 53(4) 887–901. https://doi.org/10.1017/S0008423920000669 · DOI
  20. Godfrey E. B. Grayman J. K. (2014). Teaching citizens: The role of open classroom climate in fostering critical consciousness among youth. Journal of Youth and Adolescence 43(11) 1801–1817. http://doi.org/10.1007/s10964-013-0084-5 · DOI
  21. Hess D. E., McAvoy P. (2015). The political classroom: Evidence and ethics in democratic education. Routledge.
  22. Hooghe M. Dassonneville R. (2013). Voters and candidates of the future: The intention of electoral participation among adolescents in 22 European countries. YOUNG 21(1) 1–28. https://doi.org/10.1177/1103308812467664 · DOI
  23. Hopfenbeck T. N. Lenkeit J. El Masri Y. Cantrell K. Ryan J. Baird J. A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the programme for international student assessment. Scandinavian Journal of Educational Research 62(3) 333–353. https://doi.org/10.1080/00313831.2016.1258726 · DOI
  24. Ichilov O. (2013). Education and democratic citizenship in a changing world. In Sears D. O., Huddy L., Jervis R. (Eds.), Oxford handbook of political psychology (pp. 637–669). Oxford University Press.
  25. Isac M. M. Maslowski R. Creemers B. Van der Werf M. G. (2014). The contribution of schooling to secondary-school students’ citizenship outcomes across countries. School Effectiveness and School Improvement 25(1) 29–63. https://doi.org/10.1080/09243453.2012.751035 · DOI
  26. Janmaat J. G. (2011). Ability grouping segregation and civic competences among adolescents. International Sociology 26(4) 455–482. https://doi.org/10.1177/0268580910393044 · DOI
  27. Jia Y. Konold T. (2021). Moving to the next level: Doubly latent multilevel mediation models with a school climate illustration. The Journal of Experimental Education 89(2) 422–440. https://doi.org/10.1080/00220973.2019.1675136 · DOI
  28. 10.1515/9781438467719 · DOI
  29. Kennedy K. J. Li L. (2016). Explaining Hong Kong students’ international achievement in civic learning. Frontiers of Education in China 11(3) 299–321. https://doi.org/10.1007/BF03397124 · DOI
  30. 10.1017/CBO9780511510595.002 · DOI
  31. Knowles R. T. (2020). Ideological composition of the classroom: Testing the effects of polarization on perceptions of open classroom climate among students in five countries. Educational Psychology 40(2) 167–185. https://doi.org/10.1080/01443410.2019.1622650 · DOI
  32. Knowles R. T. McCafferty-Wright J. (2015). Connecting an open classroom climate to social movement citizenship: A study of 8th graders in Europe using IEA ICCS data. The Journal of Social Studies Research 39(4) 255–269. https://doi.org/10.1016/j.jssr.2015.03.002 · DOI
  33. Kuang X. Kennedy K. J. Mok M. M. C. (2018). Creating democratic classrooms in Asian contexts: The influences of individual and school level factors on open classroom climate. Journal of Social Science Education 17(1) 29–40. https://doi.org/10.4119/jsse-863 · DOI
  34. Kudrnáč A. Lyons P. (2018). Can political inequality be reduced in the classroom? Testing the compensation hypothesis and the BFLPE on youth civic competence. School Effectiveness and School Improvement 29(2) 204–224. https://doi.org/10.1080/09243453.2017.1400444 · DOI
  35. Lenkeit J. Chan J. Hopfenbeck T. N. Baird J. A. (2015). A review of the representation of PIRLS related research in scientific journals. Educational Research Review 16 102–115. https://doi.org/10.1016/j.edurev.2015.10.002 · DOI
  36. Lin A. R. (2014). Examining students’ perception of classroom openness as a predictor of civic knowledge: A cross-national analysis of 38 countries. Applied Developmental Science 18(1) 17–30. https://doi.org/10.1080/10888691.2014.864204 · DOI
  37. Lin A. R. (2015). Citizenship education in American schools and its role in developing civic engagement: A review of the research. Educational Review 67(1) 35–63. https://doi.org/10.1080/00131911.2013.813440 · DOI
  38. Liou P. Y. Hung Y. C. (2015). Statistical techniques utilized in analyzing PISA and TIMSS data in science education from 1996 to 2013: A methodological review. International Journal of Science and Mathematics Education 13(6) 1449–1468. https://doi.org/10.1007/s10763-014-9558-5 · DOI
  39. Lüdtke O. Marsh H. W. Robitzsch A. Trautwein U. (2011). A 2 × 2 taxonomy of multilevel latent contextual models: Accuracy-bias trade-offs in full and partial error correction models. Psychological Methods 16(4) 444–467. https://doi.org/10.1037/a0024376 · DOI
  40. Lüdtke O. Marsh H. W. Robitzsch A. Trautwein U. Asparouhov T. Muthén B. (2009). The multilevel latent covariate model: A new more reliable approach to group-level effects in contextual studies. Psychological Methods 13(3) 203–229. https://doi.org/10.1037/a0012869 · DOI
  41. Maiello C. Oser F. Biedermann H. (2003). Civic knowledge civic skills and civic engagement. European Educational Research Journal 2(3) 384–395. https://doi.org/10.2304/eerj.2003.2.3.5 · DOI
  42. Malak-Minkiewicz B. Torney-Purta J. (Eds.). (2021). Influences of the IEA civic and citizenship education studies: Practice policy and research across countries and regions. Springer. https://doi.org/10.1007/978-3-030-71102-3 · DOI
  43. Manganelli S. Lucidi F. Alivernini F. (2015). Italian adolescents’ civic engagement and open classroom climate: The mediating role of self-efficacy. Journal of Applied Developmental Psychology 41 8–18. https://doi.org/10.1016/j.appdev.2015.07.001 · DOI
  44. Moher D. Liberati A. Tetzlaff J. Altman D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Annals of Internal Medicine 151(4) 264–269. https://doi.org/10.7326/0003-4819-151-4-200908180-00135 · DOI · Paper page
  45. Morin A. J. Blais A. R. Chénard-Poirier L. A. (2022). Doubly latent multilevel procedures for organizational assessment and prediction. Journal of Business and Psychology 37(1) 47–72. https://doi.org/10.1007/s10869-021-09736-5 · DOI
  46. Morin A. J. Marsh H. W. Nagengast B. Scalas L. F. (2014). Doubly latent multilevel analyses of classroom climate: An illustration. The Journal of Experimental Education 82(2) 143–167. https://doi.org/10.1080/00220973.2013.769412 · DOI
  47. Marsh H. W. Lüdtke O. Nagengast B. Trautwein U. Morin A. J. Abduljabbar A. S. Köller O. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist 47(2) 106–124. https://doi.org/10.1080/00461520.2012.670488 · DOI
  48. Marsh H. W. Lüdtke O. Robitzsch A. Trautwein U. Asparouhov T. Muthén B. Nagengast B. (2009). Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research 44(6) 764–802. https://doi.org/10.1080/00273170903333665 · DOI
  49. Maurissen L. (2020). Political efficacy and interest as mediators of expected political participation among Belgian adolescents. Applied Developmental Science 24(4) 339–353. https://doi.org/10.1080/10888691.2018.1507744 · DOI
  50. Maurissen L. Barber C. Claes E. (2020). Classroom discussions and political tolerance towards immigrants: The importance of mutual respect and responsiveness. Acta Politica 55(2) 242–266. https://doi.org/10.1057/s41269-018-0114-0 · DOI
  51. Michael D. Tsigilis N. Michaelidou V. Gregoriadis A. Charalambous V. Vrasidas C. (2024). Evaluating the classroom environment: Multilevel validation and measurement invariance of classroom behavioral climate. Journal of Psychoeducational Assessment 42(5) 512–526. https://doi.org/10.1177/07342829241242350 · DOI
  52. Myoung E. Liou P.-Y. (2022a). Systematic review of empirical studies on international large-scale assessments of civic and citizenship education. Scandinavian Journal of Educational Research 66(7) 1269–1291. https://doi.org/10.1080/00313831.2022.2131903 · DOI
  53. Myoung E. Liou P.-Y. (2022b). Adolescents’ political socialization at school citizenship self-efficacy and expected electoral participation. Journal of Youth and Adolescence 51(7) 1305–1316. https://doi.org/10.1007/s10964-022-01581-w · DOI
  54. Perliger A. Canetti-Nisim D. Pedahzur A. (2006). Democratic attitudes among high-school pupils: The role played by perceptions of class climate. School Effectiveness and School Improvement 17(1) 119–140. https://doi.org/10.1080/09243450500405217 · DOI
  55. Quintelier E. Hooghe M. (2013). The relationship between political participation intentions of adolescents and a participatory democratic climate at school in 35 countries. Oxford Review of Education 39(5) 567–589. https://doi.org/10.1080/03054985.2013.830097 · DOI
  56. Reichert F. Chen J. Torney-Purta J. (2018). Profiles of adolescents’ perceptions of democratic classroom climate and students’ influence: The effect of school and community contexts. Journal of Youth and Adolescence 47(6) 1279–1298. https://doi.org/10.1007/s10964-018-0831-8 · DOI
  57. Robinson K. A. (2023). Motivational climate theory: Disentangling definitions and roles of classroom motivational support climate and microclimates. Educational Psychologist 58(2) 92–110. https://doi.org/10.1080/00461520.2023.2198011 · DOI
  58. Sampermans D. Isac M. M. Claes E. (2018). Can schools engage students? Multiple perspectives multidimensional school climate research in England and Ireland. Journal of Social Science Education 17(1) 13–28. https://doi.org/10.4119/jsse-857 · DOI
  59. Schulz W., Ainley J., Fraillon J. (Eds.). (2011). ICCS 2009 technical report. The International Association for the Evaluation of Educational Achievement.
  60. Schulz W., Carstens R., Losito B., Fraillon J. (Eds.). (2018). ICCS 2016 technical report. The International Association for the Evaluation of Educational Achievement.
  61. Schulz W., Sibberns H. (Eds.). (2004). IEA civic education study technical report. The International Association for the Evaluation of Educational Achievement.
  62. Stapleton L. M. Johnson T. L. (2019). Models to examine the validity of cluster-level factor structure using individual-level data. Advances in Methods and Practices in Psychological Science 2(3) 312–329. https://doi.org/10.1177/2515245919855039 · DOI
  63. Stapleton L. M. McNeish D. M. Yang J. S. (2016). Multilevel and single-level models for measured and latent variables when data are clustered. Educational Psychologist 51(3–4) 317–330. https://doi.org/10.1080/00461520.2016.1207178 · DOI
  64. 10.1023/A:1011098109834 · DOI
  65. Torney-Purta J., Lehehmann R., Oswald H., Schulz W. (2001). Citizenship and education in twenty eight countries: Civic knowledge and engagement at age fourteen. The International Association for the Evaluation of Educational Achievement.
  66. Treviño E. Béjares C. Villalobos C. Naranjo E. (2017). Influence of teachers and schools on students’ civic outcomes in Latin America. The Journal of Educational Research 110(6) 604–618. https://doi.org/10.1080/00220671.2016.1164114 · DOI
  67. Witschge J. van de Werfhorst H. G. (2015). Standardization of lower secondary civic education and inequality of the civic and political engagement of students. School Effectiveness and School Improvement 27(3) 367–384. https://doi.org/10.1080/09243453.2015.1068817 · DOI
  68. Zhu J. Chiu M. M. (2020). Immigrant students in Denmark: Why are they disadvantaged in civic learning? Educational Psychology 40(2) 207–226. https://doi.org/10.1080/01443410.2019.1657560 · DOI
  69. Zhu J. Kennedy K. J. Mok M. M. C. Halse C. M. (2019). Chinese immigrant students in Hong Kong: Exploring performance and influences on their civic learning. Psychology Journal 8(4) 465–479. https://doi.org/10.1002/pchj.260a · DOI
  70. Ziemes J. F. Hahn-Laudenberg K. Abs H. J. (2019). From connectedness and learning to European and national identity: Results from fourteen European countries. Journal of Social Science Education 18(3) 1–24. https://doi.org/10.4119/JSSE-1144 · DOI

Metadata

Authors
Myoung, E., & Liou, P.-Y.
Affiliations
  • Stanford University (US)
  • Korea University (KR)
Corresponding author
Liou, Pey-Yan
ORCID
Venue
Sage Open
Publisher
SAGE Publications
Published
2025-01
Volume
15
Issue
1
ISSN
2158-2440 (ISSN-L)
DOI
10.1177/21582440251323560
OpenAlex
W4408365675
Cited by
13
References
1
Citations by year
2026: 12 · 2025: 1
FWCI
10.81
Type
journal article
Language
en
Open access
Licence
Locations
  • SAGE Open (publishedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
College of Education, Korea University Grant in 2024 (K2408331)
Topics
  • Social Sciences › Education › Citizenship Education and Democracy
  • Social Sciences › Education › Educational Environments and Student Outcomes
  • Social Sciences › Education › Educator Training and Historical Pedagogy
Keywords
construct conceptualization, construct operationalization, ICCS, international large-scale assessment, citizenship education, adolescents, secondary analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review