The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
The Estimation of School Effects
Abstract
The increasing public demand to hold schools accountable for their effects on student outcomes lends urgency to the task of clarifying statistical issues pertaining to studies of school effects. This article considers the specification and estimation of school effects, the variability of effects across schools, and the proportion of variation in student outcomes attributable to differences in school context and practice. We present a statistical model that defines two different types of school effect: one appropriate for parents choosing schools for their children, the second for agencies evaluating school practice. Studies of both types of effect are viewed as quasi-experiments posing formidable obstacles to valid causal inference. A multilevel decomposition of variance within and between schools has important and perhaps counterintuitive implications for school evaluation. The potential for unbiased estimation depends on the type of effect under consideration because the two types of school effect have markedly different data requirements. Commonly used estimators of each effect are shown to be biased and, in some cases, inconsistent. Analyses of survey data from Scotland illustrate the recommended techniques. We conclude with a brief discussion of the role of school evaluation in a broader agenda of research in support of school improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Handbook of Theory and Research for the Sociology of Education.
O'Shea, D. W., & Richardson, J. G. (1987) · Contemporary Sociology · doi:10.2307/2069964 · Cited by 15,142
Handbook of research on teaching
Wittrock, M. C. (1986) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 10,626
Review of research in education
Shulman, L. S., Mowry, S., & Berliner, D. C. (1973) · F.E. Peacock eBooks · Cited by 7,754
EQUALITY OF EDUCATIONAL OPPORTUNITY
Coleman, J. S. (1968) · Equity & Excellence in Education · doi:10.1080/0020486680060504 · Cited by 5,308
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,660
A leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229
Equality of Educational Opportunity.
Sewell, W. H., Coleman, J. S., Campbell, E. Q., Hobson, C. J., McPartland, J., Mood, A. M., Weinfeld, F. D., & York, R. L. (1967) · American Sociological Review · doi:10.2307/2091094 · Cited by 2,753
Equality of Educational Opportunity.
Marascuilo, L. A., Coleman, J. S., Campbell, E. Q., Hobson, C. J., McPartland, J., Mood, A. M., Weinfeld, F. D., & York, R. L. (1967) · American Sociological Review · doi:10.2307/2091095 · Cited by 2,532
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Mcgill, R., Tukey, J. W., & Larsen, W. A. (1978) · The American Statistician · doi:10.1080/00031305.1978.10479236 · Cited by 2,490
Multilevel Models in Educational and Social Research
Tate, R. L., & Goldstein, H. (1988) · Journal of Educational Statistics · doi:10.2307/1164754 · Cited by 993
A Hierarchical Model for Studying School Effects
Raudenbush, S., & Bryk, A. S. (1986) · Sociology of Education · doi:10.2307/2112482 · Cited by 818
Self-citationStatistical Modelling Issues in School Effectiveness Studies
Aitkin, M., & Longford, N. (1986) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981882 · Cited by 790
Journal of Educational Measurement
(2014) · Journal of Educational Measurement · doi:10.1111/(issn)1745-3984 · Cited by 563
Journal of education policy – 1985–2020
Ball, S. J. (2020) · Journal of Education Policy · doi:10.1080/02680939.2019.1681617 · Cited by 530
Multilevel Models in Educational and Social Research.
Bell, J. F., & Goldstein, H. (1988) · The Statistician · doi:10.2307/2348777 · Cited by 480
Suburbanization and Segregation in U.S. Metropolitan Areas
Massey, D. S., & Denton, N. A. (1988) · American Journal of Sociology · doi:10.1086/229031 · Cited by 364
Educational Applications of Hierarchical Linear Models: A Review
Raudenbush, S. W. (1988) · Journal of Educational Statistics · doi:10.2307/1164748 · Cited by 301
Self-citationContext and Consex: A Cautionary Tale
Hauser, R. M. (1970) · American Journal of Sociology · doi:10.1086/224894 · Cited by 300
A Longitudinal Hierarchical Linear Model for Estimating School Effects and Their Stability
Willms, J. D., & Raudenbush, S. W. (1989) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1989.tb00329.x · Cited by 268
Self-citationMonitoring School Performance: A Guide for Educators
(1994) · School Effectiveness and School Improvement · doi:10.1080/0924345940050404 · Cited by 258
Social Class Segregation and Its Relationship to Pupils' Examination Results in Scotland
Willms, J. D. (1986) · American Sociological Review · doi:10.2307/2095518 · Cited by 250
Self-citationResearch on Effective Schools: A Cautionary Note
Rowan, B., Bossert, S. T., & Dwyer, D. C. (1983) · Educational Researcher · doi:10.2307/1175653 · Cited by 222
Hinkley, D. V. (1988) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1988.tb01731.x · Cited by 201
Chapter 4: The Analysis of Multilevel Data in Educational Research and Evaluation
Burstein, L. (1980) · Review of Research in Education · doi:10.3102/0091732x008001158 · Cited by 167
Chapter 2: To Use Their Minds Well: Investigating New Forms of Student Assessment
Wolf, D., Bixby, J., Glenn, J., & Gardner, H. (1991) · Review of Research in Education · doi:10.3102/0091732x017001031 · Cited by 161
Schooling the Discouraged Worker: Local-Labour-Market Effects on Educational Participation
Raffe, D., & Willms, J. D. (1989) · Sociology · doi:10.1177/0038038589023004004 · Cited by 82
Self-citationAssessing School Effects: Some Identities
Alwin, D. F. (1976) · Sociology of Education · doi:10.2307/2112315 · Cited by 72
Kreft, I. G. G. (1990) · Cited by 45
The Effects of Ability Grouping on the Ethnic Achievement Gap in Israeli Elementary Schools
Willms, J. D., & Chen, M. (1989) · American Journal of Education · doi:10.1086/443926 · Cited by 29
Self-citation
Cited by
The disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056
Fixed and random effects models: making an informed choice
Bell, A., Fairbrother, M., & Jones, K. (2019) · Quality & Quantity · doi:10.1007/s11135-018-0802-x · Cited by 1,085
League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance
Goldstein, H., & Spiegelhalter, D. J. (1996) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983325 · Cited by 1,069
The (mis)estimation of neighborhood effects: causal inference for a practicable social epidemiology
Oakes, J. M. (2004) · Social Science & Medicine · doi:10.1016/j.socscimed.2003.08.004 · Cited by 760
Models for Value-Added Modeling of Teacher Effects
McCaffrey, D. F., Lockwood, J. R., Koretz, D., Louis, T. A., & Hamilton, L. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029001067 · Cited by 513
Metadata
- Authors
- Raudenbush, S. W., & Willms, J. D.
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 1995
- Volume
- 20
- Issue
- 4
- Pages
- 307
- ISSN
- 1076-9986 (ISSN-L)
- OpenAlex
- W2140134152
- Cited by
- 546
- References
- 32
- FWCI
- 45.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.