The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
The Estimation of School Effects
Abstract
The increasing public demand to hold schools accountable for their effects on student outcomes lends urgency to the task of clarifying statistical issues pertaining to studies of school effects. This article considers the specification and estimation of school effects, the variability of effects across schools, and the proportion of variation in student outcomes attributable to differences in school context and practice. We present a statistical model that defines two different types of school effect: one appropriate for parents choosing schools for their children, the second for agencies evaluating school practice. Studies of both types of effect are viewed as quasi-experiments posing formidable obstacles to valid causal inference. A multilevel decomposition of variance within and between schools has important and perhaps counterintuitive implications for school evaluation. The potential for unbiased estimation depends on the type of effect under consideration because the two types of school effect have markedly different data requirements. Commonly used estimators of each effect are shown to be biased and, in some cases, inconsistent. Analyses of survey data from Scotland illustrate the recommended techniques. We conclude with a brief discussion of the role of school evaluation in a broader agenda of research in support of school improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Handbook of Theory and Research for the Sociology of Education.
O'Shea, D. W., & Richardson, J. G. (1987) · Contemporary Sociology · doi:10.2307/2069964 · Cited by 15,142
Handbook of research on teaching
Wittrock, M. C. (1986) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 10,623
Review of research in education
Shulman, L. S., Mowry, S., & Berliner, D. C. (1973) · F.E. Peacock eBooks · Cited by 7,754
EQUALITY OF EDUCATIONAL OPPORTUNITY
Coleman, J. S. (1968) · Equity & Excellence in Education · doi:10.1080/0020486680060504 · Cited by 5,308
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,660
A leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229
Equality of Educational Opportunity.
Sewell, W. H., Coleman, J. S., Campbell, E. Q., Hobson, C. J., McPartland, J., Mood, A. M., Weinfeld, F. D., & York, R. L. (1967) · American Sociological Review · doi:10.2307/2091094 · Cited by 2,753
Equality of Educational Opportunity.
Marascuilo, L. A., Coleman, J. S., Campbell, E. Q., Hobson, C. J., McPartland, J., Mood, A. M., Weinfeld, F. D., & York, R. L. (1967) · American Sociological Review · doi:10.2307/2091095 · Cited by 2,532
Cited by
The disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056
Fixed and random effects models: making an informed choice
Bell, A., Fairbrother, M., & Jones, K. (2019) · Quality & Quantity · doi:10.1007/s11135-018-0802-x · Cited by 1,085
League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance
Goldstein, H., & Spiegelhalter, D. J. (1996) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983325 · Cited by 1,069
The (mis)estimation of neighborhood effects: causal inference for a practicable social epidemiology
Oakes, J. M. (2004) · Social Science & Medicine · doi:10.1016/j.socscimed.2003.08.004 · Cited by 760
Models for Value-Added Modeling of Teacher Effects
McCaffrey, D. F., Lockwood, J. R., Koretz, D., Louis, T. A., & Hamilton, L. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029001067 · Cited by 513
Handbook of Research on Schools, Schooling and Human Development
(2010) · Routledge eBooks · doi:10.4324/9780203874844 · Cited by 502
The Distribution of Dropout and Turnover Rates among Urban and Suburban High Schools
Rumberger, R. W., & Thomas, S. L. (2000) · Sociology of Education · doi:10.2307/2673198 · Cited by 451
Controlling for Student Background in Value-Added Assessment of Teachers
Ballou, D., Sanders, W., & Wright, P. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029001037 · Cited by 434
Estimating neighborhood health effects: the challenges of causal inference in a complex world
Diez Roux, A. V. (2004) · Social Science & Medicine · doi:10.1016/s0277-9536(03)00414-3 · Cited by 386
Class Size and Student Achievement
Ehrenberg, R. G., Brewer, D. J., Gamoran, A., & Willms, J. D. (2001) · Psychological Science in the Public Interest · doi:10.1111/1529-1006.003 · Cited by 385
Self-citationSchool Choice, School Quality, and Postsecondary Attainment
Deming, D. J., Hastings, J. S., Kane, T. J., & Staiger, D. O. (2014) · American Economic Review · doi:10.1257/aer.104.3.991 · Cited by 334
Test Scores, Dropout Rates, and Transfer Rates as Alternative Indicators of High School Performance
Rumberger, R. W., & Palardy, G. J. (2005) · American Educational Research Journal · doi:10.3102/00028312042001003 · Cited by 299
Methods in School Effectiveness Research
Goldstein, H. (1997) · School Effectiveness and School Improvement · doi:10.1080/0924345970080401 · Cited by 280
Palardy, G. J., & Rumberger, R. W. (2008) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373708317680 · Cited by 279
Rothstein, J. M. (2006) · American Economic Review · doi:10.1257/aer.96.4.1333 · Cited by 277
Croon, M. A., & van Veldhoven, M. J. P. M. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.45 · Cited by 276
Improving student achievement: what state NAEP test scores tell us
(2001) · Choice Reviews Online · doi:10.5860/choice.38-4019 · Cited by 261
Do schools influence student risk-taking behaviors and emotional health symptoms?
Denny, S. J., Robinson, E. M., Utter, J., Fleming, T. M., Grant, S., Milfont, T. L., Crengle, S., Ameratunga, S. N., & Clark, T. (2011) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2010.06.020 · Cited by 87
Stavrova, O., & Denissen, J. (2021) · Social Psychological and Personality Science · doi:10.1177/1948550620944304 · Cited by 49
Mendelson, T., Clary, L. K., Sibinga, E., Tandon, D., Musci, R., Mmari, K., Salkever, D., Stuart, E. A., & Ialongo, N. (2020) · Contemporary Clinical Trials · doi:10.1016/j.cct.2019.105895 · Cited by 25
Denny, S., Robinson, E., Lawler, C., Bagshaw, S., Farrant, B., Bell, F., Dawson, D., Nicholson, D., Hart, M., Fleming, T., et al. (2012) · American Journal of Public Health · doi:10.2105/ajph.2012.300775 · Cited by 24
Metadata
- Authors
- Raudenbush, S. W., & Willms, J. D.
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 1995
- Volume
- 20
- Issue
- 4
- Pages
- 307
- ISSN
- 1076-9986 (ISSN-L)
- OpenAlex
- W2140134152
- Cited by
- 546
- References
- 32
- FWCI
- 45.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.