The DOI matches its Crossref record; 244 of the 244 references it cites were found in a registry or an index.
Systematic reviews in the social sciences: a practical guide
Abstract
Such diverse thinkers as Lao-Tze, Confucius, and U.S. Defense Secretary Donald Rumsfeld have all pointed out that we need to be able to tell the difference between real and assumed knowledge. The systematic review is a scientific tool that can help with this difficult task. It can help, for example, with appraising, summarising, and communicating the results and implications of otherwise unmanageable quantities of data. This is important because quite often there are so many studies, and their results are often so conflicting, that no policymaker or practitioner could possibly carry out this task themselves.Systematic review methods have been widely used in health care, and are becoming increasingly common in the social sciences (fostered, for example, by the work of the Campbell Collaboration). This book outlines the rationale and methods of systematic reviews, giving worked examples from social science and other fields. It requires no previous knowledge, but takes the reader through the process stage by stage. It draws on examples from such diverse fields as psychology, criminology, education, transport, social welfare, public health, and housing and urban policy, among others.The book includes detailed sections on assessing the quality of both quantitative, and qualitative research; searching for evidence in the social sciences;meta-analytic and other methods of evidence synthesis; publication bias; heterogeneity; and approaches to dissemination.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
The Reflective Practitioner: How Professionals Think in Action
Checkoway, B., & Schon, D. A. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3324262 · Cited by 21,268
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
(2014) · Medical Entomology and Zoology · Cited by 17,633
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
(1963) · Medical Entomology and Zoology · Cited by 15,085
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
(2002) · Cited by 13,211
(1979) · Medical Entomology and Zoology · Cited by 11,252
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Downs, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Mortality in relation to smoking: 40 years' observations on male British doctors
Doll, R., Peto, R., Wheatley, K., Gray, R., & Sutherland, I. (1994) · BMJ · doi:10.1136/bmj.309.6959.901 · Cited by 5,932
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
Judgement under Uncertainty: Heuristics and Biases
Hirschman, E. C., Kahneman, D., Slovic, P., & Tversky, A. (1983) · Journal of Marketing Research · doi:10.2307/3151689 · Cited by 3,813
Qualitative research in health care: Assessing quality in qualitative research
Mays, N. (2000) · BMJ · doi:10.1136/bmj.320.7226.50 · Cited by 3,742
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Interventions for preventing obesity in children
Brown, T., Moore, T. H., Hooper, L., Gao, Y., Zayegh, A., Ijaz, S., Elwenspoek, M., Foxen, S. C., Magee, L., O'Malley, C., et al. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001871.pub4 · Cited by 2,982
Users' guides to the medical literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 2,970
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613
Quantitative Synthesis in Systematic Reviews
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-9-199711010-00008 · Cited by 2,517
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Dilemmas in qualitative health research
Yardley, L. (2000) · Psychology & Health · doi:10.1080/08870440008400302 · Cited by 2,310
Systematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,256
Investigating and dealing with publication and other biases in meta-analysis
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · BMJ · doi:10.1136/bmj.323.7304.101 · Cited by 2,225
Meta-Ethnography: Synthesizing Qualitative Studies
Noblit, G. W., & Hare, R. D. (1988) · Medical Entomology and Zoology · Cited by 2,191
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075
Charbonneau, D. H. (2005) · Europe PMC (PubMed Central) · Cited by 2,041
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Parametric measures of effect size.
Rosenthal, R. (1994) · Cited by 1,847
(2000) · Queen Mary Research Online (Queen Mary University of London) · Cited by 1,795
Quality in Qualitative Research
Seale, C. (1999) · Qualitative Inquiry · doi:10.1177/107780049900500402 · Cited by 1,743
Is caregiving hazardous to one’s physical health? A meta-analysis
Vitaliano, P. P., Zhang, J., & Scanlan, J. M. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.6.946 · Cited by 1,734
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Systematic Reviews: Rationale for systematic reviews
Mulrow, C. D. (1994) · BMJ · doi:10.1136/bmj.309.6954.597 · Cited by 1,677
Why we need observational studies to evaluate the effectiveness of health care
Black, N. (1996) · BMJ · doi:10.1136/bmj.312.7040.1215 · Cited by 1,598
Effectiveness of mentoring programs for youth: A meta-analytic review
DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002) · American Journal of Community Psychology · doi:10.1023/a:1014628810714 · Cited by 1,544
Empirical assessment of effect of publication bias on meta-analyses
Sutton, A. J. (2000) · BMJ · doi:10.1136/bmj.320.7249.1574 · Cited by 1,398
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Hemingway, H., & Marmot, M. (1999) · BMJ · doi:10.1136/bmj.318.7196.1460 · Cited by 1,340
Systematic reviews of evaluations of diagnostic and screening tests
Deeks, J. J. (2001) · BMJ · doi:10.1136/bmj.323.7305.157 · Cited by 1,340
Bonta, J. L., Law, M. A., & Hanson, K. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.123.2.123 · Cited by 1,250
Psychological debriefing for preventing post traumatic stress disorder (PTSD)
Rose, S. C., Bisson, J., Churchill, R., & Wessely, S. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000560 · Cited by 1,250
Complex interventions: how “out of control” can a randomised controlled trial be?
Hawe, P., Shiell, A., & Riley, T. (2004) · BMJ · doi:10.1136/bmj.328.7455.1561 · Cited by 1,244
Appraising the Evidence: Reviewing Disparate Data Systematically
Hawker, S., Payne, S., Kerr, C., Hardey, M., & Powell, J. (2002) · Qualitative Health Research · doi:10.1177/1049732302238251 · Cited by 1,216
Ukoumunne, Gulliford, Chinn, Sterne, & Burney (1999) · Health Technology Assessment · doi:10.3310/hta3050 · Cited by 1,210
Chang, J. T., Morton, S. C., Rubenstein, L. Z., Mojica, W. A., Maglione, M., Suttorp, M. J., Roth, E. A., & Shekelle, P. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.680 · Cited by 1,168
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140
Using meta ethnography to synthesise qualitative research: a worked example
Britten, N., Campbell, R., Pope, C., Donovan, J., Morgan, M., & Pill, R. (2002) · Journal of Health Services Research & Policy · doi:10.1258/135581902320432732 · Cited by 1,110
Criteria for evaluating evidence on public health interventions
Rychetnik, L., Frommer, M., Hawe, P., & Shiell, A. (2002) · Journal of Epidemiology and Community Health · doi:10.1136/jech.56.2.119 · Cited by 1,042
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017
Meta-analysis Spurious precision? Meta-analysis of observational studies
Egger, M., Schneider, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7125.140 · Cited by 997
Popay, J., Rogers, A., & Williams, G. (1998) · Qualitative Health Research · doi:10.1177/104973239800800305 · Cited by 987
Sterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964
Conducting systematic reviews of diagnostic studies: didactic guidelines
Devillé, W. L., Buntinx, F., Bouter, L. M., Montori, V. M., de Vet, H. C., van der Windt, D. A., & Bezemer, P. D. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-9 · Cited by 960
Best evidence synthesis: An intelligent alternative to meta-analysis
Slavin, R. E. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00097-a · Cited by 949
Song, F., Altman, D. G., Glenny, A.-M., & Deeks, J. J. (2003) · BMJ · doi:10.1136/bmj.326.7387.472 · Cited by 943
(2003) · Digital Education Resource Archive (University College London) · Cited by 902
Scientific Knowledge and its Social Problems.
Lyon, A., & Ravetz, J. R. (1973) · The Philosophical Quarterly · doi:10.2307/2218013 · Cited by 849
Fraisse, P. (1963) · Medical Entomology and Zoology · Cited by 825
Smith, G. D., Morris, J. N., & Shaw, M. (1998) · BMJ · doi:10.1136/bmj.317.7171.1465 · Cited by 813
Validation of an index of the quality of review articles
Oxman, A. D., & Guyatt, G. H. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90160-b · Cited by 786
National Institute for Clinical Excellence and its value judgments
Rawlins, M. D., & Culyer, A. J. (2004) · BMJ · doi:10.1136/bmj.329.7459.224 · Cited by 765
Forest plots: trying to see the wood and the trees
Lewis, S., & Clarke, M. (2001) · BMJ · doi:10.1136/bmj.322.7300.1479 · Cited by 763
Efron, B., & Morris, C. (1977) · Scientific American · doi:10.1038/scientificamerican0577-119 · Cited by 739
Impact of covert duplicate publication on meta-analysis: a case study
Tramèr, M. R., Reynolds, D. J. M., Moore, R. A., & McQuay, H. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.635 · Cited by 702
Best-Evidence Synthesis: An Alternative to Meta-Analytic and Traditional Reviews
Slavin, R. E. (1986) · Educational Researcher · doi:10.2307/1174711 · Cited by 698
Do Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials
Vickers, A., Goyal, N., Harland, R., & Rees, R. (1998) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00150-5 · Cited by 683
The problem of appraising qualitative research
Dixon-Woods, M. (2004) · Quality and Safety in Health Care · doi:10.1136/qshc.2003.008714 · Cited by 653
Callaham, M. (2002) · JAMA · doi:10.1001/jama.287.21.2847 · Cited by 644
Poverty, Income Inequality, and Violent Crime: A Meta-Analysis of Recent Aggregate Data Studies
Hsieh, C.-C., & Pugh, M. D. (1993) · Criminal Justice Review · doi:10.1177/073401689301800203 · Cited by 643
The effectiveness of early childhood development programs
Anderson, L. M., Shinn, C., Fullilove, M. T., Scrimshaw, S. C., Fielding, J. E., Normand, J., & Carande-Kulis, V. G. (2003) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(02)00655-4 · Cited by 614
Systematic review of water fluoridation
McDonagh, M. S. (2000) · BMJ · doi:10.1136/bmj.321.7265.855 · Cited by 608
Evidence-Based Crime Prevention
Welsh, B. C., & Farrington, D. P. (2007) · Preventing Crime · doi:10.1007/978-0-387-69169-5_1 · Cited by 596
Integrating Research: A Guide for Literature Reviews
Kolbe, R. H., & Cooper, H. M. (1991) · Journal of Marketing Research · doi:10.2307/3172876 · Cited by 594
Brookes, S. T., Whitley, E., Peters, T. J., Mulheran, P. A., Egger, M., & Davey Smith, G. (2001) · Health Technology Assessment · doi:10.3310/hta5330 · Cited by 580
Meta-analysis of screening and diagnostic tests.
Hasselblad, V., & Hedges, L. V. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.1.167 · Cited by 579
How to read a paper: Papers that summarise other papers (systematic reviews and meta-analyses)
Greenhalgh, T. (1997) · BMJ · doi:10.1136/bmj.315.7109.672 · Cited by 578
Briss (2000) · doi:10.1016/s0749-3797(99)00119-1 · Cited by 565
Study of the Aetiology of Carcinoma of the Lung
Doll, R., & Hill, A. B. (1952) · BMJ · doi:10.1136/bmj.2.4797.1271 · Cited by 562
“Food deserts”—evidence and assumption in health policy making
Cummins, S., & Macintyre, S. (2002) · BMJ · doi:10.1136/bmj.325.7361.436 · Cited by 558
A brief history of research synthesis
Chalmers, I., Hedges, L. V., & Cooper, H. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001003 · Cited by 552
Underreporting Research Is Scientific Misconduct
Chalmers, L. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100121018 · Cited by 551
Systematic Reviews from Astronomy to Zoology: Myths and Misconceptions
Petticrew, M. (2001) · BMJ · doi:10.1136/bmj.322.7278.98 · Cited by 550
Evidence, hierarchies, and typologies: horses for courses: Table 1
Petticrew, M., & Roberts, H. (2003) · Journal of Epidemiology and Community Health · doi:10.1136/jech.57.7.527 · Cited by 539
The Integrative Research Review: A Systematic Approach
Cooper, H. (1986) · Educational Researcher · doi:10.2307/1175261 · Cited by 537
Foundations of Program Evaluation: Theories of Practice.
Chen, H.-T., Shadish, W. R., Cook, T. D., & Leviton, L. C. (1992) · Contemporary Sociology · doi:10.2307/2074800 · Cited by 534
Mirza, I., & Jenkins, R. (2004) · BMJ · doi:10.1136/bmj.328.7443.794 · Cited by 531
Integrating qualitative research with trials in systematic reviews
Thomas, J., Harden, A., Oakley, A., Oliver, S., Sutcliffe, K., Rees, R., Brunton, G., & Kavanagh, J. (2004) · BMJ · doi:10.1136/bmj.328.7446.1010 · Cited by 515
Experiments in Knowing: Gender and Method in the Social Sciences
Sprague, J., & Oakley, A. (2001) · Contemporary Sociology · doi:10.2307/3089296 · Cited by 512
Egger, M., & Smith, G. D. (1995) · BMJ · doi:10.1136/bmj.310.6982.752 · Cited by 508
DiCenso, A., Guyatt, G., Willan, A., & Griffith, L. (2002) · BMJ · doi:10.1136/bmj.324.7351.1426 · Cited by 485
Young people and healthy eating: a systematic review of research on barriers and facilitators
Shepherd, J. (2005) · Health Education Research · doi:10.1093/her/cyh060 · Cited by 484
Systematic Reviews: Checklists for review articles
Oxman, A. D. (1994) · BMJ · doi:10.1136/bmj.309.6955.648 · Cited by 480
The Science of Reviewing Researcha
OXMAN, A. D., & GUYATT, G. H. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26342.x · Cited by 472
Developing and implementing clinical practice guidelines.
Grimshaw, J., Freemantle, N., Wallace, S., Russell, I., Hurwitz, B., Watt, I., Long, A., & Sheldon, T. (1995) · Quality in Health Care · doi:10.1136/qshc.4.1.55 · Cited by 469
An exercise in mega-silliness.
Eysenck, H. J. (1978) · American Psychologist · doi:10.1037//0003-066x.33.5.517.a · Cited by 466
Zaza, S., Wright-De Agüero, L. K., Briss, P. A., Truman, B. I., Hopkins, D. P., Hennessy, M. H., Sosin, D. M., Anderson, L., Carande-Kulis, V. G., Teutsch, S. M., et al. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00122-1 · Cited by 464
Publication and Related Biases
Song, F., Eastwood, A., Gilbody, S., Duley, L., & Sutton, A. (2001) · The Advanced Handbook of Methods in Evidence Based Healthcare · doi:10.4135/9781848608344.n21 · Cited by 455
Investigating and Dealing with Publication and Other Biases
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch11 · Cited by 449
Accumulating Evidence: Procedures for Resolving Contradictions among Different Research Studies
Light, R., & Smith, P. (1971) · Harvard Educational Review · doi:10.17763/haer.41.4.437714870334w144 · Cited by 445
THE ART OF SCIENTIFIC INVESTIGATION
(1951) · Australian Veterinary Journal · doi:10.1111/j.1751-0813.1951.tb05043.x · Cited by 425
Spiegelhalter, D. J., Myles, J. P., Jones, D. R., & Abrams, K. R. (1999) · BMJ · doi:10.1136/bmj.319.7208.508 · Cited by 421
Stevenson, F. A., Cox, K., Britten, N., & Dundar, Y. (2004) · Health Expectations · doi:10.1111/j.1369-7625.2004.00281.x · Cited by 418
BIASES IN THE INTERPRETATION AND USE OF RESEARCH RESULTS
MacCoun, R. J. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.259 · Cited by 417
How to read a paper: Papers that report diagnostic or screening tests
Greenhalgh, T. (1997) · BMJ · doi:10.1136/bmj.315.7107.540 · Cited by 398
Quality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397
Publication Bias in Editorial Decision Making
Olson, C. M. (2002) · JAMA · doi:10.1001/jama.287.21.2825 · Cited by 395
The Effects of Psychological Therapy
(1980) · Elsevier eBooks · doi:10.1016/c2013-0-03226-4 · Cited by 393
Assessing the quality of research.
Glasziou, P., Vandenbroucke, J., & Chalmers, I. (2004) · BMJ · doi:10.1136/bmj.328.7430.39 · Cited by 391
Health effects of housing improvement: systematic review of intervention studies
Thomson, H., Petticrew, M., & Morrison, D. (2001) · BMJ · doi:10.1136/bmj.323.7306.187 · Cited by 376
Getting to grips with Archie Cochrane's agenda.
Chalmers, I., Dickersin, K., & Chalmers, T. C. (1992) · BMJ · doi:10.1136/bmj.305.6857.786 · Cited by 375
Statistical versus traditional procedures for summarizing research findings.
Cooper, H. M., & Rosenthal, R. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.87.3.442 · Cited by 353
Methodological Quality Standards for Evaluation Research
Farrington, D. P. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716202250789 · Cited by 352
Puffer, S., Torgerson, D., & Watson, J. (2003) · BMJ · doi:10.1136/bmj.327.7418.785 · Cited by 351
The Interface between Evaluation and Public Policy
Weiss, C. H. (1999) · Evaluation · doi:10.1177/135638909900500408 · Cited by 349
Social and biological pathways linking early life and adult disease
Power, C., & Hertzman, C. (1997) · British Medical Bulletin · doi:10.1093/oxfordjournals.bmb.a011601 · Cited by 342
Meta-analysis: Statistical alchemy for the 21st century
Feinstein, A. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00110-c · Cited by 339
Organizational story and storytelling: a critical review
Boyce, M. E. (1996) · Journal of Organizational Change Management · doi:10.1108/09534819610128760 · Cited by 337
Sharpe, D. (1997) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00056-1 · Cited by 334
The effects of psychological stress upon performance.
Lazarus, R. S., Deese, J., & Osler, S. F. (1952) · Psychological Bulletin · doi:10.1037/h0061145 · Cited by 319
Choosing between randomised and non-randomised studies: a systematic review.
Britton, McKee, Black, McPherson, Sanderson, & Bain (1998) · Health Technology Assessment · doi:10.3310/hta2130 · Cited by 308
Qualitative methods for assessing health care.
Fitzpatrick, R., & Boulton, M. (1994) · Quality in Health Care · doi:10.1136/qshc.3.2.107 · Cited by 298
Finding qualitative research: an evaluation of search strategies
Shaw, R. L., Booth, A., Sutton, A. J., Miller, T., Smith, J. A., Young, B., Jones, D. R., & Dixon-Woods, M. (2004) · BMC Medical Research Methodology · doi:10.1186/1471-2288-4-5 · Cited by 295
Systematic Reviews: Meta-analysis and its problems
Eysenck, H. J. (1994) · BMJ · doi:10.1136/bmj.309.6957.789 · Cited by 293
Nelson, H. D., Nygren, P., McInerney, Y., & Klein, J. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-5-200403020-00015 · Cited by 292
Narrative Research in Health and Illness
(2004) · Wiley eBooks · doi:10.1002/9780470755167 · Cited by 285
Magnus, P., & Jaakkola, J. J. K. (1997) · BMJ · doi:10.1136/bmj.314.7097.1795 · Cited by 279
Policy analysis: a systematic approach to supporting policymaking in the public sector
Walker, W. E. (2000) · Journal of Multi-Criteria Decision Analysis · doi:10.1002/1099-1360(200001/05)9:1/3<11::aid-mcda264>3.0.co;2-3 · Cited by 277
Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment
Heckman, J., Hohmann, N., Smith, J., & Khoo, M. (2000) · The Quarterly Journal of Economics · doi:10.1162/003355300554764 · Cited by 266
Gilbert, R., Salanti, G., Harden, M., & See, S. (2005) · International Journal of Epidemiology · doi:10.1093/ije/dyi088 · Cited by 261
The Pocket Guide to Critical Appraisal: A Handbook for Health Care Professionals
Crombie, I. (1996) · BMJ Publishing Group eBooks · Cited by 254
Methods for Exploring Heterogeneity in Meta-Analysis
Song, F., Sheldon, T. A., Sutton, A. J., Abrams, K. R., & Jones, D. R. (2001) · Evaluation & the Health Professions · doi:10.1177/01632780122034849 · Cited by 253
(2004) · UCL Discovery (University College London) · Cited by 246
Systematic reviews of trials and other studies.
Sutton, Abrams, Jones, Sheldon, & Song (1998) · Health Technology Assessment · doi:10.3310/hta2190 · Cited by 246
DEVINE, E. C., & COOK, T. D. (1983) · Nursing Research · doi:10.1097/00006199-198309000-00003 · Cited by 241
A Meta-Analysis of Longitudinal Research on Preschool Prevention Programs for Children.
Nelson, G., Westhues, A., & MacLeod, J. (2003) · Prevention & Treatment · doi:10.1037/1522-3736.6.1.631a · Cited by 238
Measuring the impact of health research
Lavis, J., Ross, S., McLeod, C., & Gildiner, A. (2003) · Journal of Health Services Research & Policy · doi:10.1258/135581903322029520 · Cited by 231
McDermott, E., & Graham, H. M. (2005) · Journal of Youth Studies · doi:10.1080/13676260500063702 · Cited by 222
'Scared Straight' and other juvenile awareness programs for preventing juvenile delinquency
Petrosino, A., Turpin-Petrosino, C., Hollis-Peel, M. E., & Lavenberg, J. G. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002796.pub2 · Cited by 216
(2003) · Evidence-Based Crime Prevention · doi:10.4324/9780203166697-9 · Cited by 213
The imprint of time: childhood, history, and adult life
(1992) · Choice Reviews Online · doi:10.5860/choice.30-1247 · Cited by 210
Maternal cigarette smoking and child psychiatric morbidity: a longitudinal study
Williams, G. M., O'Callaghan, M., Najman, J. M., Bor, W., Andersen, F. M. J., Richards, A. D., & BSc, C. U. (1998) · PEDIATRICS · doi:10.1542/peds.102.1.e11 · Cited by 203
How Consumers and Policymakers Can Use Systematic Reviews for Decision Making
Bero, L. A., & Jadad, A. R. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-1-199707010-00007 · Cited by 196
Researcher allegiance and meta-analysis: The case of cognitive therapy for depression.
Gaffan, E. A., Tsaousis, I., & Kemp-Wheeler, S. M. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.63.6.966 · Cited by 194
Meta-analysis of research on the relationship of class-size and achievement
Glass, G. V., & Smith, M. L. (1981) · Medical Entomology and Zoology · Cited by 193
Petrosino, A., Turpin-Petrosino, C., & Buehler, J. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716203254693 · Cited by 193
Sensitivity analysis and diagnostics.
Greenhouse, J. B., & Iyengar, S. (1994) · Cited by 192
Publishing Protocols of Systematic Reviews: Comparing What Was Done to What Was Planned
Silagy, C. A., Middleton, P., & Hopewell, S. (2002) · JAMA · doi:10.1001/jama.287.21.2831 · Cited by 188
McManus, R. J., Wilson, S., Delaney, B. C., Fitzmaurice, D. A., Hyde, C. J., Tobias, R. S., Jowett, S., & Hobbs, F. D. R. (1998) · BMJ · doi:10.1136/bmj.317.7172.1562 · Cited by 185
Why certain systematic reviews reach uncertain conclusions
Petticrew, M. (2003) · BMJ · doi:10.1136/bmj.326.7392.756 · Cited by 181
Identifying Clinical Trials in the Medical Literature with Electronic Databases
Suarez-Almazor, M. E., Belseck, E., Homik, J., Dorgan, M., & Ramos-Remus, C. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00067-2 · Cited by 180
Database searches for qualitative research.
Evans, D. J. (2002) · Europe PMC (PubMed Central) · Cited by 179
Gray, J. A. M. (2004) · BMJ · doi:10.1136/bmj.329.7473.988 · Cited by 178
Social Science and Evidence-based Everything: The case of education
Oakley, A. (2002) · Educational Review · doi:10.1080/0013191022000016329 · Cited by 176
Systematic reviews : synthesis of best evidence for health care decisions
Mulrow, C. D., & Cook, D. J. (1998) · American College of Physicians eBooks · Cited by 172
The relation between treatment benefit and underlying risk in meta-analysis
Sharp, S. J., Thompson, S. G., & Altman, D. G. (1996) · BMJ · doi:10.1136/bmj.313.7059.735 · Cited by 172
Is science losing its objectivity?
Ziman, J. (1996) · Nature · doi:10.1038/382751a0 · Cited by 167
Estimating Time to Conduct a Meta-analysis From Number of Citations Retrieved
Allen, I. E. (1999) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.282.7.634 · Cited by 163
Attrition and bias in the MRC cognitive function and ageing study: an epidemiological investigation
Matthews, F. E., Chatfield, M., Freeman, C., McCracken, C., Brayne, C., & CFAS, M. (2004) · BMC Public Health · doi:10.1186/1471-2458-4-12 · Cited by 162
Shadish, W. R. (1996) · Psychological Methods · doi:10.1037//1082-989x.1.1.47 · Cited by 162
Systematic Research Synthesis to Inform Policy, Practice and Democratic Debate
Gough, D., & Elbourne, D. (2002) · Social Policy and Society · doi:10.1017/s147474640200307x · Cited by 161
Roberts, K. A., Dixon-Woods, M., Fitzpatrick, R., Abrams, K. R., & Jones, D. R. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11560-1 · Cited by 159
The Maryland Scientific Methods Scale
(2003) · Evidence-Based Crime Prevention · doi:10.4324/9780203166697-7 · Cited by 158
The Campbell Collaboration: Does for public policy what Cochrane does for health
Davies, P., & Boruch, R. F. (2001) · BMJ · doi:10.1136/bmj.323.7308.294 · Cited by 155
Wortman, P. M. (1994) · Cited by 154
Wu, S., & Margolina, A. (1990) · Polymer · doi:10.1016/0032-3861(90)90068-a · Cited by 154
Using Research for Effective Health Promotion
Oliver, S. R., & Peersman, G. (2001) · Medical Entomology and Zoology · Cited by 151
Comparing the Impact of Homosexual and Heterosexual Parents on Children:
Allen, M., & BURRELL, N. A. (1997) · Journal of Homosexuality · doi:10.1300/j082v32n02_02 · Cited by 140
Bambra, C. L., Whitehead, M. M., & Hamilton, V. (2004) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.09.002 · Cited by 140
Myers, R. A., MacKenzie, B. R., Bowen, K. G., & Barrowman, N. J. (2001) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f01-082 · Cited by 136
School-Based Violence Prevention Programs: Systematic Review of Secondary Prevention Trials
Mytton, J. A., DiGuiseppi, C. G., Gough, D., Taylor, R. S., & Logan, S. (2002) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.156.8.752 · Cited by 134
The well-being of children in the UK
Bradshaw, J. (2011) · Policy Press eBooks · doi:10.1332/policypress/9781847428370.001.0001 · Cited by 128
Advocacy for public health: a primer: Figure 1
Chapman, S. F. (2004) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2003.018051 · Cited by 128
Roberts, H. M., Curtis, K., Liabo, K., Rowland, D., DiGuiseppi, C. G., & Roberts, I. (2004) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2003.007948 · Cited by 127
Meeting the challenge: developing systematic reviewing in social policy
Wallace, A., Baldwin, S. J., Croucher, K., & Quilgars, D. (2004) · Policy & Politics · doi:10.1332/0305573042009444 · Cited by 125
Hetherington, J., Dickersin, K., Chalmers, I., & Meinert, C. L. (1989) · PEDIATRICS · doi:10.1542/peds.84.2.374 · Cited by 124
Boynton, J., Glanville, J., McDaid, D., & Lefebvre, C. (1998) · Journal of Information Science · doi:10.1177/016555159802400301 · Cited by 122
Catching Goldfish: Quality in Qualitative Research
Dingwall, R. W. J., Murphy, E., Watson, P., Greatbatch, D., & Parker, S. (1998) · Journal of Health Services Research & Policy · doi:10.1177/135581969800300308 · Cited by 121
Aid to the Evaluation of Therapeutic Studies
REISCH, J. S., Tyson, J. E., & Mize, S. G. (1989) · PEDIATRICS · doi:10.1542/peds.84.5.815 · Cited by 120
Getting Research Findings Into Practice
Gray, J. A. M. (2002) · Wiley eBooks · doi:10.1002/9780470755891 · Cited by 118
Factors Affecting Attrition in a Longitudinal Smoking Prevention Study
Siddiqui, O. I., Flay, B. R., & Hu, F. B. (1996) · Preventive Medicine · doi:10.1006/pmed.1996.0089 · Cited by 117
Lefebvre, C., & Clarke, M. J. (2001) · doi:10.1002/9780470693926.ch4 · Cited by 115
Meta-analytic stimulus for changes in clinical trials
Harvard, T. C., & Lau, J. (1993) · Statistical Methods in Medical Research · doi:10.1177/096228029300200204 · Cited by 115
Effective Reading Programs for English Language Learners. A Best-Evidence Synthesis.
Slavin, R. E., & Cheung, A. (2003) · Cited by 113
Riemsma, R., Pattenden, J., Bridle, C., Sowden, A. J., Mather, L., Watt, I. S., & Walker, A. (2002) · Health Technology Assessment · doi:10.3310/hta6240 · Cited by 113
Psychological consequences of brain lesions and ablations.
Klebanoff, S. G., Singer, J. L., & Wilensky, H. (1954) · Psychological Bulletin · doi:10.1037/h0060182 · Cited by 113
The role of modelling in prioritising and planning clinical trials
Chilcott, J. B., Brennan, A., Booth, A., Karnon, J. D., & Tappenden, P. (2003) · Health Technology Assessment · doi:10.3310/hta7230 · Cited by 111
Evaluating the health effects of social interventions
Thomson, H., Hoskins, R., Petticrew, M. P., Craig, N. J., Quinn, T., Lindsay, G., & Ogilvie, D. (2004) · BMJ · doi:10.1136/bmj.328.7434.282 · Cited by 103
Cited by
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Guidance on Conducting a Systematic Literature Review
Xiao, Y., & Watson, M. (2019) · Journal of Planning Education and Research · doi:10.1177/0739456x17723971 · Cited by 3,467
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Metadata
- Venue
- Choice Reviews Online
- Publisher
- American Library Association
- Published
- 2006-06-01
- Volume
- 43
- Issue
- 10
- Pages
- 43-5664-43-5664
- ISSN
- 0009-4978 (ISSN-L)
- 1523-8253
- OpenAlex
- W1562463929
- Cited by
- 4,089
- References
- 244
- Type
- book review
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.