The DOI matches its Crossref record; 90 of the 90 references it cites were found in a registry or an index.
A practitioner's guide to meta‐analysis
Abstract
Conclusion: Meta‐analysis can be a powerful and useful technique. In the short term, the results of meta‐analysis can increase understanding and influence the future endeavors of researchers interested in a particular field. Over the long term, meta‐analysis provides a vehicle by which large bodies of research can be integrated and focused on public policy issues. Administrative structures currently exist to foster the relationship between research findings and public policy. As one example, Saxe (1986) has described the activities of the Office of Technology Assessment (OTA) established by Congress to provide lawmakers with scientific information in such a way as to be useful for policy decision‐making. OTA is commissioned by Congress to provide assessments of scientific findings, and meta‐analyses are an ideal resource in this regard. Saxe (1986) notes “In almost all cases, the emphasis is on making sense of already collected data, thus literature reviews and methods for synthesizing research results are relied upon” (pp. 61–62). Whether meta‐analysis actually plays an important role in public policy depends on many factors, not the least of which is the care with which meta‐analyses are conducted. Hopefully, our comments here will help investigators conduct methodologically rigorous meta‐analyses of research relevant to the field of community psychology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
(1979) · Medical Entomology and Zoology · Cited by 11,252
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 1×
“Since the work of Glass (1976) , meta-analysis has become commonplace within the behavioral and social sciences.”
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,784
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings.
Raudenbush, S. W., Hunter, J. E., & Schmidt, F. L. (1991) · Journal of the American Statistical Association · doi:10.2307/2289738 · Cited by 2,327
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Smith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064
Summing up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Summing Up: The Science of Reviewing Research
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,427
Family Factors as Correlates and Predictors of Juvenile Conduct Problems and Delinquency
Loeber, R., & Stouthamer-Loeber, M. (1986) · Crime and Justice · doi:10.1086/449112 · Cited by 1,409
Meta-Analysis: Quantitative Methods for Research Synthesis
Rosenthal, R., & Wolf, F. M. (1987) · Contemporary Sociology · doi:10.2307/2071646 · Cited by 1,371
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
A simple, general purpose display of magnitude of experimental effect.
Rosenthal, R., & Rubin, D. B. (1982) · Journal of Educational Psychology · doi:10.1037//0022-0663.74.2.166 · Cited by 1,229
Meta-Analysis: Cumulating Research Findings across Studies
Feldman, J. M., Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1984) · The Academy of Management Review · doi:10.2307/258247 · Cited by 1,199
Estimation of effect size from a series of independent experiments.
Hedges, L. V. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.2.490 · Cited by 1,062
A variance explanation paradox: When a little is a lot.
Abelson, R. P. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.1.129 · Cited by 1,045
Design Sensitivity: Statistical Power for Experimental Research.
Eliason, S. R., & Lipsey, M. W. (1991) · Contemporary Sociology · doi:10.2307/2072167 · Cited by 1,040
Self-citationLife of the mind: The interface of psychopharmaceuticals, domestic economies, and social abandonment
Biehl, J. (2004) · American Ethnologist · doi:10.1525/ae.2004.31.4.475 · Cited by 903
A meta-analysis of the efficacy of cognitive therapy for depression.
Dobson, K. S. (1989) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.57.3.414 · Cited by 823 · cited 1×
“Since then hundreds of others have been conducted, from cognitive therapy for depression ( Dobson, 1989 ) to effects of examiner familiarity on children's test performance (Fuchs & Fuchs, 1989).”
BackgroundMeta-Analysis: Cumulating Research Findings across Studies
Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1986) · Educational Researcher · doi:10.2307/1175263 · Cited by 792
Wolf, F. (1986) · doi:10.4135/9781412984980 · Cited by 784
Design Sensitivity: Statistical Power for Experimental Research.
Lachenbruch, P. A., & Lipsey, M. W. (1990) · Journal of the American Statistical Association · doi:10.2307/2289636 · Cited by 782
Self-citationBest-Evidence Synthesis: An Alternative to Meta-Analytic and Traditional Reviews
Slavin, R. E. (1986) · Educational Researcher · doi:10.2307/1174711 · Cited by 698
Robinson, L. A., Berman, J. S., & Neimeyer, R. A. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.108.1.30 · Cited by 671
Effectiveness of psychotherapy with children and adolescents: A meta-analysis for clinicians.
Weisz, J. R., Weiss, B., Alicke, M. D., & Klotz, M. L. (1987) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.55.4.542 · Cited by 581
The Integrative Research Review: A Systematic Approach
Cooper, H. (1986) · Educational Researcher · doi:10.2307/1175261 · Cited by 537
How large are cognitive gender differences? A meta-analysis using !w² and d..
Hyde, J. S. (1981) · American Psychologist · doi:10.1037/0003-066x.36.8.892 · Cited by 529
Methods for Integrative Reviews
Jackson, G. B. (1980) · Review of Educational Research · doi:10.2307/1170440 · Cited by 484
Tait, M., Padgett, M. Y., & Baldwin, T. T. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.3.502 · Cited by 459
Meta-Analysis for Explanation: A Casebook.
Jackson, S., Cook, T. D., Cooper, H., Cordray, D. S., Hartmann, H., Hedges, L. V., Light, R. J., Louis, T. A., & Mosteller, F. (1993) · Contemporary Sociology · doi:10.2307/2074578 · Cited by 434
Comparing effect sizes of independent studies.
Rosenthal, R., & Rubin, D. B. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.2.500 · Cited by 406
A random effects model for effect sizes.
Hedges, L. V. (1983) · Psychological Bulletin · doi:10.1037//0033-2909.93.2.388 · Cited by 399
Kazdin, A. E., & Bass, D. (1989) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.57.1.138 · Cited by 337
Review of developments in meta-analytic method.
Bangert-Drowns, R. L. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.3.388 · Cited by 327
Effectiveness of cognitive-behavior therapy for maladapting children: A meta-analysis.
Durlak, J. A., Fuhrman, T., & Lampman, C. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.110.2.204 · Cited by 316
Self-citationFitting Categorical Models to Effect Sizes from a Series of Experiments
Hedges, L. V. (1982) · Journal of Educational Statistics · doi:10.2307/1164961 · Cited by 296
Publication bias and meta-analysis
Smith, M. L. (1980) · Evaluation in Education · doi:10.1016/0191-765x(80)90004-x · Cited by 214
The efficacy of cognitive behavior therapies: A quantitative review of the research evidence.
Miller, R. C., & Berman, J. S. (1983) · Psychological Bulletin · doi:10.1037//0033-2909.94.1.39 · Cited by 199
Modeling multivariate effect sizes.
Raudenbush, S. W., Becker, B. J., & Kalaian, H. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.1.111 · Cited by 195
Measures of explained variance: Cautions and limitations.
O'Grady, K. E. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.3.766 · Cited by 195
The role of judgment calls in meta-analysis.
Wanous, J. P., Sullivan, S. E., & Malinak, J. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.2.259 · Cited by 171
Time and method in coaching for the SAT.
Messick, S., & Jungeblut, A. (1981) · Psychological Bulletin · doi:10.1037/0033-2909.89.2.191 · Cited by 163
Sackett, P. R., Harris, M. M., & Orr, J. M. (1986) · Journal of Applied Psychology · doi:10.1037/0021-9010.71.2.302 · Cited by 152
Advances in statistical methods for meta‐analysis
Hedges, L. V. (1984) · New Directions for Program Evaluation · doi:10.1002/ev.1376 · Cited by 142 · cited 2×
“Hedges and Olkin (1985) have developed useful statistical procedures for evaluating hypothesized differences among effect sizes (see also Hedges, 1982b, 1984 ).”
MethodFitting Continuous Models to Effect Size Data
Hedges, L. V. (1982) · Journal of Educational Statistics · doi:10.3102/10769986007004245 · Cited by 128
Sex differences in occupational stress: A meta-analytic review.
Martocchio, J. J., & O'Leary, A. M. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.495 · Cited by 120
Implementation Problems in Meta-Analysis
Abrami, P. C., Cohen, P. A., & d’Apollonia, S. (1988) · Review of Educational Research · doi:10.3102/00346543058002151 · Cited by 118
Research methodology: Strengthening causal interpretations of nonexperimental data
(1990) · Cancer Causes & Control · doi:10.1007/bf00053175 · Cited by 113
Sex Differences in Neuroticism: A Quantitative Synthesis of Published Research
Jorm, A. F. (1987) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048678709158917 · Cited by 109
Analyzing meta-analysis: Potential problems, an unsuccessful replication, and evaluation criteria.
Bullock, R. J., & Svyantek, D. J. (1985) · Journal of Applied Psychology · doi:10.1037/0021-9010.70.1.108 · Cited by 108
School Desegregation and Black Achievement
Wortman, P. M., & Bryant, F. B. (1985) · Sociological Methods & Research · doi:10.1177/0049124185013003002 · Cited by 104
Effects of deficient reporting on meta-analysis: A conceptual framework and reanalysis.
Orwin, R. G., & Cordray, D. S. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.1.134 · Cited by 102
Comparative therapy outcome research: Methodological implications of meta-analysis.
Shapiro, D. A., & Shapiro, D. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.1.42 · Cited by 100
Spector, P. E., & Levine, E. L. (1987) · Journal of Applied Psychology · doi:10.1037/0021-9010.72.1.3 · Cited by 97
Evaluation Research: A Methodological Perspective
Wortman, P. M. (1983) · Annual Review of Psychology · doi:10.1146/annurev.ps.34.020183.001255 · Cited by 97
Self-statement modification with adults: A meta-analysis.
Dush, D. M., Hirt, M. L., & Schrøeder, H. E. (1983) · Psychological Bulletin · doi:10.1037/0033-2909.94.3.408 · Cited by 95
The experimental evidence for weight-loss treatment of essential hypertension: a critical review.
Hovell, M. F. (1982) · American Journal of Public Health · doi:10.2105/ajph.72.4.359 · Cited by 91
Evaluation: The state of the art and the sorry state of the science
Lipsey, M. W., Crosse, S. B., Dunkle, J., Pollard, J. A., & Stobart, G. (1985) · New Directions for Program Evaluation · doi:10.1002/ev.1398 · Cited by 90
Self-citationThe use of meta-analysis to assess the clinical significance of behavior therapy for agoraphobia
Trull, T., Nietzel, M. T., & Main, A. (1988) · Behavior Therapy · doi:10.1016/s0005-7894(88)80021-2 · Cited by 80
Paternal Absence and Sex-Role Development: A Meta-Analysis
Stevenson, M. R., & BLACK, K. N. (1988) · Child Development · doi:10.1111/j.1467-8624.1988.tb03236.x · Cited by 77
Rigor in Data Synthesis: A Case Study of Reliability in Meta-Analysis
Stock, W. A., Okun, M. A., Haring, M. J., Miller, W., Kinney, C., & Ceurvorst, R. W. (1982) · Educational Researcher · doi:10.3102/0013189x011006010 · Cited by 68
Magnitudes of Experimental Effects in Social Science Research
SECHREST, L. B., & Yeaton, W. H. (1982) · Evaluation Review · doi:10.1177/0193841x8200600501 · Cited by 66
Social support appraisals and network resources
Vaux, A., & Athanassopulou, M. (1987) · Journal of Community Psychology · doi:10.1002/1520-6629(198710)15:4<481::aid-jcop2290150406>3.0.co;2-e · Cited by 66
Paternal Absence and Sex-Role Development: A Meta-Analysis
Stevenson, M. R., & BLACK, K. N. (1988) · Child Development · doi:10.2307/1130577 · Cited by 62
The Coleman Report: Using Inappropriately Designed Achievement Tests
Carver, R. P. (1975) · American Educational Research Journal · doi:10.2307/1162582 · Cited by 54
Practice and malpractice in evaluation research
Lipsey, M. W. (1988) · Evaluation Practice · doi:10.1016/s0886-1633(88)80001-1 · Cited by 53
Self-citationMatt, G. E. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.1.106 · Cited by 53
Shadish, W. R., Doherty, M., & Montgomery, L. M. (1989) · Clinical Psychology Review · doi:10.1016/0272-7358(89)90013-5 · Cited by 46
Effects of Examiner Familiarity on Black, Caucasian, and Hispanic Children: A Meta-Analysis
Fuchs, D., & Fuchs, L. S. (1989) · Exceptional Children · doi:10.1177/001440298905500403 · Cited by 39
Strube, M., Gardner, W. P., & Hartmann, D. P. (1985) · Clinical Psychology Review · doi:10.1016/0272-7358(85)90030-3 · Cited by 38
The relation between Type A behavior and chronic emotional distress: A meta-analysis.
Suls, J. M., & Wan, C. K. (1989) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.57.3.503 · Cited by 35
Limitations of meta-analysis in the evaluation of the effects of psychological therapy
Wilson, G. T. (1985) · Clinical Psychology Review · doi:10.1016/0272-7358(85)90028-5 · Cited by 32
Quality of Study Rating Form: An Instrument for Synthesizing Evaluation Studies
Gibbs, L. E. (1989) · Journal of Social Work Education · doi:10.1080/10437797.1989.10671270 · Cited by 25
Effect Size Estimation in Meta-Analysis
Holmes, C. T. (1984) · The Journal of Experimental Education · doi:10.1080/00220973.1984.11011878 · Cited by 25
Research synthesis reviews: an illustrated critique of “hidden” judgments, choices, and compromises
Nurius, P. S., & Yeaton, W. H. (1987) · Clinical Psychology Review · doi:10.1016/0272-7358(87)90014-6 · Cited by 21
Policymakers' Use of Social Science Research: Technology Assessment in the U.S. Congress
Saxe, L. (1986) · Science Communication · doi:10.1177/107554708600800104 · Cited by 14
The Meta-Analysis Effect Size Calculator: A Basic Program for Reconstructing Unbiased Effect Sizes
Curlette, W. L. (1987) · Educational and Psychological Measurement · doi:10.1177/0013164487471012 · Cited by 6
Measurement effects on outcome of treatment for agoraphobia
Chambless, D. L. (1989) · Behavior Therapy · doi:10.1016/s0005-7894(89)80063-2 · Cited by 5
Meta analysis, clinical psychology, and social policy
Kiesler, C. A. (1985) · Clinical Psychology Review · doi:10.1016/0272-7358(85)90026-1 · Cited by 4
Cited by
Maternal depression and parenting behavior
Lovejoy, M. C., Graczyk, P. A., O'Hare, E., & Neuman, G. (2000) · Clinical Psychology Review · doi:10.1016/s0272-7358(98)00100-7 · Cited by 2,667
Evolving guidelines for publication of qualitative research studies in psychology and related fields
Elliott, R., Fischer, C. T., & Rennie, D. L. (1999) · British Journal of Clinical Psychology · doi:10.1348/014466599162782 · Cited by 2,491
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
Self-citationEffectiveness of mentoring programs for youth: A meta-analytic review
DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002) · American Journal of Community Psychology · doi:10.1023/a:1014628810714 · Cited by 1,544
“The present research utilizes meta-analysis to review and synthesize the existing empirical literature on youth mentoring programs (Cooper, 1998; Durlak & Lipsey, 1991).”
BackgroundMethodDewald, J. F., Meijer, A. M., Oort, F. J., Kerkhof, G. A., & Bögels, S. M. (2010) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2009.10.004 · Cited by 1,526
Metadata
- Authors
- Durlak, J. A., & Lipsey, M. W.
- Venue
- American Journal of Community Psychology
- Publisher
- Wiley
- Published
- 1991-06
- Volume
- 19
- Issue
- 3
- Pages
- 291-332
- ISSN
- 0091-0562 (ISSN-L)
- 1573-2770
- OpenAlex
- W1707346075
- Cited by
- 284
- References
- 90
- FWCI
- 10.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.