The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Classroom Climate and Contextual Effects: Conceptual and Methodological Issues in the Evaluation of Group-Level Effects
Abstract
Classroom context and climate are inherently classroom-level (L2) constructs, but applied researchers sometimes—inappropriately—represent them by student-level (L1) responses in single-level models rather than more appropriate multilevel models. Here we focus on important conceptual issues (distinctions between climate and contextual variables; use of classroom L2 rather than student-level L1 measures) and more appropriate multilevel models. To illustrate these issues, we consider the effects of two L2 classroom climate variables and one L2 classroom contextual variable on two L1 student-level outcomes for 2261 students in 128 classes. Through this example, we illustrate how to apply evolving doubly latent multilevel models to (a) evaluate the factor structure of L1 and L2 constructs based on multiple indicators of classroom climate and context measures, (b) control measurement error at L1 and L2, (c) control sampling error in the aggregation of L1 responses to form L2 constructs (the average of student-level responses to form classroom-level constructs), and (d) provide guidelines for appropriate analysis of classroom climate as an L2 construct. [Supplementary materials are available for this article. Go to the publisher's online edition of Educational Psychologist for the following free supplemental resources: Substantive basis of the present investigation and more detailed description of the methodology.]
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Classrooms: Goals, structures, and student motivation.
Ames, C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.3.261 · Cited by 6,468
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
Klein, K. J., & Kozlowski, S. W. J. (2000) · Cited by 4,914
Centering predictor variables in cross-sectional multilevel models: A new look at an old issue.
Enders, C. K., & Tofighi, D. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.2.121 · Cited by 4,462
LISREL 7 : a guide to the program and applications
Jöreskog, K. G., & Sörbom, D. (1989) · Medical Entomology and Zoology · Cited by 4,299
A general multilevel SEM framework for assessing multilevel mediation
Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010) · Psychological Methods · doi:10.1037/a0020141 · Cited by 3,796
(2000) · Cited by 3,573
Gill, J. (2005) · Encyclopedia of Social Measurement · doi:10.1016/b0-12-369398-5/00166-3 · Cited by 3,114
(2000) · Cited by 2,531
Fifteen Thousand Hours: Secondary Schools and Their Effects on Children
Armento, B. J., Rutter, M., Maughan, B., Mortimore, P., & Ouston, J. (1980) · Educational Researcher · doi:10.2307/1175642 · Cited by 2,289
Statistical Analysis with Missing Data
Bo., N., Little, R. J. A., & Rubin, D. B. (1988) · Population (French Edition) · doi:10.2307/1533221 · Cited by 2,095
Structural Equation Modeling: Foundations and Extensions
Kaplan, D. E. (2000) · University of Maribor digital library (University of Maribor) · Cited by 1,896
(2007) · Cited by 1,428
Marsh, H. W., & Craven, R. G. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00010.x · Cited by 1,368
Self-citationGoal theory, motivation, and school achievement: an integrative review.
Covington, M. V. (2000) · Annual Review of Psychology · doi:10.1146/annurev.psych.51.1.171 · Cited by 1,316
Goulias, K. (2002) · New Directions in Civil Engineering · doi:10.1201/9781420042283.ch9 · Cited by 1,270
Multilevel Covariance Structure Analysis
MUTHÉN, B. O. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003006 · Cited by 1,171
Wang, M.-T., & Holcombe, R. (2010) · American Educational Research Journal · doi:10.3102/0002831209361209 · Cited by 1,166
Counterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2007) · doi:10.1017/cbo9780511804564 · Cited by 1,146
Latent Variable Modeling in Heterogeneous Populations
Muthén, B. O. (1989) · Psychometrika · doi:10.1007/bf02296397 · Cited by 1,008
Heckhausen, J., & Heckhausen, H. (2008) · Cited by 923
Alternative methods for assessing mediation in multilevel data: The advantages of multilevel SEM
Preacher, K. J., Zhang, Z., & Zyphur, M. J. (2011) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2011.557329 · Cited by 889
The Effect of Different Forms of Centering in Hierarchical Linear Models
Kreft, I. G. G., de Leeuw, J., & Aiken, L. S. (1995) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3001_1 · Cited by 850
Generalized Multilevel Structural Equation Modeling
Rabe-Hesketh, S., Skrondal, A., & Pickles, A. (2004) · Psychometrika · doi:10.1007/bf02295939 · Cited by 831
Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008) · Psychological Methods · doi:10.1037/a0012869 · Cited by 823
Self-citation(2013) · Bayesian Data Analysis · doi:10.1201/b16018-21 · Cited by 631
Marsh, H. W. (1990) · Journal of Educational Psychology · doi:10.1037//0022-0663.82.4.646 · Cited by 605
Self-citationGoals, Goal Structures, and Patterns of Adaptive Learning
(2014) · Routledge eBooks · doi:10.4324/9781410602152 · Cited by 601
Lüdtke, O., Robitzsch, A., Trautwein, U., & Kunter, M. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2008.12.001 · Cited by 485
Self-citationMarsh, H. W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthén, B., & Nagengast, B. (2009) · Multivariate Behavioral Research · doi:10.1080/00273170903333665 · Cited by 481
Self-citationRegression Among Factor Scores
Skrondal, A., & Laake, P. (2001) · Psychometrika · doi:10.1007/bf02296196 · Cited by 479
People are variables too: Multilevel structural equations modeling.
Mehta, P. D., & Neale, M. C. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.3.259 · Cited by 467
Marsh, H. W., Seaton, M., Trautwein, U., Lüdtke, O., Hau, K. T., O’Mara, A. J., & Craven, R. G. (2008) · Educational Psychology Review · doi:10.1007/s10648-008-9075-6 · Cited by 467
Self-citationTrautwein, U., Lüdtke, O., Marsh, H. W., Köller, O., & Baumert, J. (2006) · Journal of Educational Psychology · doi:10.1037/0022-0663.98.4.788 · Cited by 450
Self-citationTIMSS — Mathematisch-naturwissenschaftlicher Unterricht im internationalen Vergleich
Baumert, J., & Lehmann, R. (1997) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-322-95096-3 · Cited by 440
Marsh, H. W. (2007) · Handbook of Sport Psychology · doi:10.1002/9781118270011.ch35 · Cited by 388
Self-citationTrautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.90.2.334 · Cited by 387
Self-citationCausal ordering of academic self-concept and achievement: Reanalysis of a pioneering study and...
Marsh, H. W., Byrne, B. M., & Yeung, A. S. (1999) · Educational Psychologist · doi:10.1207/s15326985ep3403_2 · Cited by 342
Self-citationRater bias in psychological research: When is it a problem and what can we do about it?
Hoyt, W. T. (2000) · Psychological Methods · doi:10.1037//1082-989x.5.1.64 · Cited by 322
Fast, L. A., Lewis, J. L., Bryant, M. J., Bocian, K. A., Cardullo, R. A., Rettig, M., & Hammond, K. A. (2010) · Journal of Educational Psychology · doi:10.1037/a0018863 · Cited by 302
Croon, M. A., & van Veldhoven, M. J. P. M. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.45 · Cited by 276
Educating teachers about managing classrooms and students
Brophy, J. (1988) · Teaching and Teacher Education · doi:10.1016/0742-051x(88)90020-0 · Cited by 274
Lüdtke, O., Marsh, H. W., Robitzsch, A., & Trautwein, U. (2011) · Psychological Methods · doi:10.1037/a0024376 · Cited by 273
Self-citationClassroom discipline and student responsibility:
Lewis, R. (2001) · Teaching and Teacher Education · doi:10.1016/s0742-051x(00)00059-7 · Cited by 264
Research on Classrooms and Schools: Formulation of Questions, Design and Analysis.
Cronbach, L. J. (1976) · Cited by 245
A General Model for the Analysis of Multilevel Data
Goldstein, H., & McDonald, R. P. (1988) · Psychometrika · doi:10.1007/bf02294400 · Cited by 240
Causal inference and developmental psychology.
Foster, E. M. (2010) · Developmental Psychology · doi:10.1037/a0020204 · Cited by 227
The Effects of Student Composition on School Outcomes
Harker, R., & Tymms, P. (2004) · School Effectiveness and School Improvement · doi:10.1076/sesi.15.2.177.30432 · Cited by 223
Brennan, R. L. (1992) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.1992.tb00260.x · Cited by 206
Classroom Factors Affecting Students' Self-Evaluations: An Interactional Model
Marshall, H. H., & Weinstein, R. S. (1984) · Review of Educational Research · doi:10.2307/1170451 · Cited by 197
Papaioannou, A., Marsh, H. W., & Theodorakis, Y. (2004) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.26.1.90 · Cited by 191
Self-citation(2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511499821 · Cited by 188
Ciani, K. D., Middleton, M., Summers, J. J., & Sheldon, K. M. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2009.11.001 · Cited by 184
Marsh, H. W., Martin, A. J., & Cheng, J. H. S. (2008) · Journal of Educational Psychology · doi:10.1037/0022-0663.100.1.78 · Cited by 180
Self-citationMultilevel Methods: Future Directions in Measurement, Longitudinal Analyses, and Nonnormal Outcomes
Bliese, P. D., Chan, D., & Ployhart, R. E. (2007) · Organizational Research Methods · doi:10.1177/1094428107301102 · Cited by 178
Teacher frame of reference and the big-fish–little-pond effect
Lüdtke, O., Köller, O., Marsh, H. W., & Trautwein, U. (2005) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2004.10.002 · Cited by 166
Self-citationImproving Classroom Management: An Experiment in Elementary School Classrooms
Evertson, C. M., Emmer, E. T., Sanford, J. P., & Clements, B. S. (1983) · The Elementary School Journal · doi:10.1086/461354 · Cited by 163
Mainhard, T., Brekelmans, M., & Wubbels, T. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2010.03.003 · Cited by 151
LaHuis, D. M., & Ferguson, M. W. (2007) · Organizational Research Methods · doi:10.1177/1094428107308984 · Cited by 145
Miller, A. D., & Murdock, T. B. (2006) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2006.10.006 · Cited by 137
Iversen, G. R. (1991) · Sage eBooks · doi:10.4135/9781412983785 · Cited by 131
Structural Models and the Art of Approximation
McDonald, R. P. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610388766 · Cited by 90
A Latent Cluster-Mean Approach to the Contextual Effects Model With Missing Data
Shin, Y., & Raudenbush, S. W. (2010) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998609345252 · Cited by 88
STUDENT EVALUATIONS OF TEACHING: THE GENERALIZABILITY OF CLASS MEANS
Kane, M. T., Gillmore, G. M., & Crooks, T. J. (1976) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1976.tb00009.x · Cited by 74
Helmke, A., Schneider, W., & Weinert, F. E. (1986) · Teaching and Teacher Education · doi:10.1016/0742-051x(86)90002-8 · Cited by 69
Nagengast, B., & Marsh, H. W. (2011) · Educational Psychology · doi:10.1080/01443410.2011.586416 · Cited by 62
Self-citationThe Bilevel Reticular Action Model for Path Analysis with Latent Variables
McDonald, R. P. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003007 · Cited by 58
A General Model for Two-Level Data with Responses Missing at Random
McDonald, R. P. (1993) · Psychometrika · doi:10.1007/bf02294828 · Cited by 52
When is a Compositional Effect not a Compositional Effect?
Hutchison, D. (2007) · Quality & Quantity · doi:10.1007/s11135-007-9094-2 · Cited by 20
Cited by
School Climate: a Review of the Construct, Measurement, and Impact on Student Outcomes
Wang, M.-T., & Degol, J. L. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9319-1 · Cited by 1,461
How teachers’ self-efficacy is related to instructional quality: A longitudinal analysis.
Holzberger, D., Philipp, A., & Kunter, M. (2013) · Journal of Educational Psychology · doi:10.1037/a0032198 · Cited by 681
Understanding the psychology of bullying: Moving toward a social-ecological diathesis–stress model.
Swearer, S. M., & Hymel, S. (2015) · American Psychologist · doi:10.1037/a0038929 · Cited by 666
Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes
Fauth, B., Decristan, J., Rieser, S., Klieme, E., & Büttner, G. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.07.001 · Cited by 600
Wang, M.-T., L. Degol, J., Amemiya, J., Parr, A., & Guo, J. (2020) · Developmental Review · doi:10.1016/j.dr.2020.100912 · Cited by 470
Metadata
- Authors
- Marsh, H. W., Lüdtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Köller, O.
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2012-04
- Volume
- 47
- Issue
- 2
- Pages
- 106-124
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W2129368568
- Cited by
- 604
- References
- 72
- FWCI
- 125.05
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.