Meta-Analysis Using Multilevel Models with an Application to the Study of Class Size Effects
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
SUMMARY: Meta-analysis is formulated as a special case of a multilevel (hierarchical data) model in which the highest level is that of the study and the lowest level that of an observation on an individual respondent. Studies can be combined within a single model where the responses occur at different levels of the data hierarchy and efficient estimates are obtained. An example is given from studies of class sizes and achievement in schools, where study data are available at the aggregate level in terms of overall mean values for classes of different sizes, and also at the student level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017 · cited 1×
“The use of random effect models in meta-analysis has been suggested by several authors (Hedges & Olkin, 1985; Raudenbush & Bryk, 1985; Hardy & Thompson, 1996; Erez et al., 1996; Cleary & Casella, 1997). The present paper focuses more on the methodology of meta analyses than the substantive issue of class size per se.…”
MethodEmpirical bayes meta-analysis.
Raudenbush, S. W., & Bryk, A. S. (1985) · Journal of Educational Statistics · doi:10.3102/10769986010002075 · Cited by 299 · cited 1×
“authors (Hedges & Olkin, 1985; Raudenbush & Bryk, 1985; Hardy & Thompson,”
EREZ, A., BLOOM, M. C., & WELLS, M. T. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb01801.x · Cited by 161
Cited by
Osbaldiston, R., & Schott, J. P. (2012) · Environment and Behavior · doi:10.1177/0013916511402673 · Cited by 754
Field, A. P. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.161 · Cited by 725
Recent developments in meta‐analysis
Sutton, A. J., & Higgins, J. P. T. (2008) · Statistics in Medicine · doi:10.1002/sim.2934 · Cited by 590
On Using Bayesian Methods to Address Small Sample Problems
McNeish, D. (2016) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2016.1186549 · Cited by 570
Fixed effects and variance components estimation in three-level meta-analysis
Konstantopoulos, S. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.35 · Cited by 521
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological Bulletin · doi:10.1037/a0020473 · Cited by 525
Self-citationDias, S., Sutton, A. J., Welton, N. J., & Ades, A. E. (2013) · Medical Decision Making · doi:10.1177/0272989x13485157 · Cited by 466
Generalisability in economic evaluation studies in healthcare: a review and case studies
Sculpher, M., Pang, F., Manca, A., Drummond, M., Golder, S., Urdahl, H., Davies, L., & Eastwood, A. (2004) · Health Technology Assessment · doi:10.3310/hta8490 · Cited by 441
School Effectiveness Findings 1979–2002
Rutter, M., & Maughan, B. (2002) · Journal of School Psychology · doi:10.1016/s0022-4405(02)00124-3 · Cited by 432
Lambert, P. C., Sutton, A. J., Abrams, K. R., & Jones, D. R. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00414-0 · Cited by 394
Multilevel modelling of medical data
Goldstein, H., Browne, W., & Rasbash, J. (2002) · Statistics in Medicine · doi:10.1002/sim.1264 · Cited by 388
Self-citationGet real in individual participant data (IPD) meta‐analysis: a review of the methodology
Debray, T. P. A., Moons, K. G. M., van Valkenhoef, G., Efthimiou, O., Hummel, N., Groenwold, R. H. H., Reitsma, J. B., & on behalf of the GetReal methods review group (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1160 · Cited by 348
“, 2013) and can, for instance, be achieved by fitting a multilevel model that includes a dummy variable indicating whether a data source relates to IPD or AD (Riley et al., 2008, 2007; Goldstein et al., 2000).”
BackgroundCooper, H., & Patall, E. A. (2009) · Psychological Methods · doi:10.1037/a0015565 · Cited by 339
An extended mixed‐effects framework for meta‐analysis
Sera, F., Armstrong, B., Blangiardo, M., & Gasparrini, A. (2019) · Statistics in Medicine · doi:10.1002/sim.8362 · Cited by 323
The paradox of reducing class size and improving learning outcomes
Hattie, J. (2005) · International Journal of Educational Research · doi:10.1016/j.ijer.2006.07.002 · Cited by 279
Meta‐analysis of continuous outcomes combining individual patient data and aggregate data
Riley, R. D., Lambert, P. C., Staessen, J. A., Wang, J., Gueyffier, F., Thijs, L., & Boutitie, F. (2008) · Statistics in Medicine · doi:10.1002/sim.3165 · Cited by 279
A multilevel model framework for meta-analysis of clinical trials with binary outcomes
Turner, R. M., Omar, R. Z., Yang, M., Goldstein, H., & Thompson, S. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001230)19:24<3417::aid-sim614>3.0.co;2-l · Cited by 265
Self-citationBornmann, L., Mutz, R., & Daniel, H.-D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0014331 · Cited by 290
Multilevel Meta-analysis: a comparison with traditional meta-analytical procedures
Van Den Noortgate, W., & Onghena, P. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403251027 · Cited by 218
“However, Hedges (1981) showed that the sampling distribution of the standardized mean difference is only approximately normal.”
BackgroundMethodInfluentialThe Effect of School Recess Interventions on Physical Activity: A Systematic Review
Parrish, A.-M., Okely, A. D., Stanley, R. M., & Ridgers, N. D. (2013) · Sports Medicine · doi:10.1007/s40279-013-0024-2 · Cited by 176
“However, few studies have reported unadjusted mean scores separately for the intervention and control groups, which makes it difficult to calculate effect sizes for use in a meta-analysis [18].”
BackgroundMarsh, H. W., Bornmann, L., Mutz, R., Daniel, H.-D., & O’Mara, A. (2009) · Review of Educational Research · doi:10.3102/0034654309334143 · Cited by 174
Meta-Analysis of Complex Interventions
Tanner-Smith, E. E., & Grant, S. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014112 · Cited by 62
Metadata
- Authors
- Goldstein, H., Yang, M., Omar, R., Turner, R., & Thompson, S.
- Venue
- Journal of the Royal Statistical Society Series C: Applied Statistics
- Publisher
- Oxford University Press (OUP)
- Published
- 2000-09-01
- Volume
- 49
- Issue
- 3
- Pages
- 399-412
- ISSN
- 0035-9254 (ISSN-L)
- 1467-9876
- OpenAlex
- W2155169765
- Cited by
- 135
- References
- 3
- FWCI
- 4.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.