The DOI matches its Crossref record.
Summing up: The Science of Reviewing Research
Abstract
1. Introduction 2. Organizing a Reviewing Strategy 3. Quantitative Procedures 4. Numbers and Narrative: The Division of Labor 5. What We Have Learned 6. A Checklist for Evaluating Reviews Reference Index
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Items 101–200 of 329
The Ordinal Effects of Ostracism: A Meta-Analysis of 120 Cyberball Studies
Hartgerink, C. H. J., van Beest, I., Wicherts, J. M., & Williams, K. D. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127002 · Cited by 558
How many words do we read per minute? A review and meta-analysis of reading rate
Brysbaert, M. (2019) · Journal of Memory and Language · doi:10.1016/j.jml.2019.104047 · Cited by 553
How much variance can be explained by ecologists and evolutionary biologists?
Møller, A., & Jennions, M. D. (2002) · Oecologia · doi:10.1007/s00442-002-0952-2 · Cited by 553
Bowden, J., Tierney, J. F., Copas, A. J., & Burdett, S. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-41 · Cited by 553
A brief history of research synthesis
Chalmers, I., Hedges, L. V., & Cooper, H. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001003 · Cited by 552
Benbow, C. P. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00049244 · Cited by 544
The Ontogeny of Plant Defense and Herbivory: Characterizing General Patterns Using Meta‐Analysis
Barton, K. E., & Koricheva, J. (2010) · The American Naturalist · doi:10.1086/650722 · Cited by 544
Do people who feel connected to nature do more to protect it? A meta-analysis
Mackay, C. M. L., & Schmitt, M. T. (2019) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.101323 · Cited by 538
Intelligence and school grades: A meta-analysis
Roth, B., Becker, N., Romeyke, S., Schäfer, S., Domnick, F., & Spinath, F. M. (2015) · Intelligence · doi:10.1016/j.intell.2015.09.002 · Cited by 531
School-Based Prevention of Problem Behaviors: A Meta-Analysis
Wilson, D. B., Gottfredson, D. C., & Najaka, S. S. (2001) · Journal of Quantitative Criminology · doi:10.1023/a:1011050217296 · Cited by 529
Siegel, E. H., Sands, M. K., Van den Noortgate, W., Condon, P., Chang, Y., Dy, J., Quigley, K. S., & Barrett, L. F. (2018) · Psychological Bulletin · doi:10.1037/bul0000128 · Cited by 515
Survival of Blacks and Whites After a Cancer Diagnosis
Bach, P. B. (2002) · JAMA · doi:10.1001/jama.287.16.2106 · Cited by 513
Balancing the strengths of systematic and narrative reviews
Collins, J. A., & Fauser, B. C. J. M. (2005) · Human Reproduction Update · doi:10.1093/humupd/dmh058 · Cited by 510
Blackhart, G. C., Nelson, B. C., Knowles, M. L., & Baumeister, R. F. (2009) · Personality and Social Psychology Review · doi:10.1177/1088868309346065 · Cited by 504
Association Between Chronic Periodontal Disease and Obesity: A Systematic Review and Meta‐Analysis
Chaffee, B. W., & Weston, S. J. (2010) · Journal of Periodontology · doi:10.1902/jop.2010.100321 · Cited by 505
Spieske, A., & Birkel, H. (2021) · Computers & Industrial Engineering · doi:10.1016/j.cie.2021.107452 · Cited by 499
Van IJzendoorn, M. H., Vereijken, C. M. J. L., Bakermans-Kranenburg, M. J., & Marianne Riksen-Walraven, J. (2004) · Child Development · doi:10.1111/j.1467-8624.2004.00733.x · Cited by 497
Terrin, N., Schmid, C. H., & Lau, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.006 · Cited by 492
Systematic review automation technologies
Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-74 · Cited by 472
Effects of Interventions to Promote Self-Determination for Individuals With Disabilities
Algozzine, B., Browder, D., Karvonen, M., Test, D. W., & Wood, W. M. (2001) · Review of Educational Research · doi:10.3102/00346543071002219 · Cited by 488
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Vevea, J. L., & Woods, C. M. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.428 · Cited by 461
Extent and scale of local adaptation in salmonid fishes: review and meta-analysis
Fraser, D. J., Weir, L. K., Bernatchez, L., Hansen, M. M., & Taylor, E. B. (2011) · Heredity · doi:10.1038/hdy.2010.167 · Cited by 487
Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy
Song, F., Khan, K. S., Dinnes, J., & Sutton, A. J. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.88 · Cited by 484
Systematic Reviews: Checklists for review articles
Oxman, A. D. (1994) · BMJ · doi:10.1136/bmj.309.6955.648 · Cited by 480
A review of the relationships between human population density and biodiversity
Luck, G. W. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00028.x · Cited by 479
Ultrasound guidance versus anatomical landmarks for internal jugular vein catheterization
Brass, P., Hellmich, M., Kolodziej, L., Schick, G., & Smith, A. F. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006962.pub2 · Cited by 476
Gender differences in ethical perceptions of business practices: A social role theory perspective.
Franke, G. R., Crown, D. F., & Spake, D. F. (1997) · Journal of Applied Psychology · doi:10.1037//0021-9010.82.6.920 · Cited by 473
Detecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436
Owen, C. G., Martin, R. M., Whincup, P. H., Smith, G. D., & Cook, D. G. (2006) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/84.5.1043 · Cited by 467
Owen, C. G., Martin, R. M., Whincup, P. H., Davey-Smith, G., Gillman, M. W., & Cook, D. G. (2005) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/82.6.1298 · Cited by 466
Empirical Comparison of Publication Bias Tests in Meta-Analysis
Lin, L., Chu, H., Murad, M. H., Hong, C., Qu, Z., Cole, S. R., & Chen, Y. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4425-7 · Cited by 464
Sterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476125 · Cited by 453
Dyadic coping and relationship satisfaction: A meta-analysis
Falconier, M. K., Jackson, J. B., Hilpert, P., & Bodenmann, G. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.07.002 · Cited by 462
Insect Performance on Experimentally Stressed Woody Plants: A Meta-Analysis
Koricheva, J., Larsson, S., & Haukioja, E. (1998) · Annual Review of Entomology · doi:10.1146/annurev.ento.43.1.195 · Cited by 459
Susceptibility of Common and Rare Plant Species to the Genetic Consequences of Habitat Fragmentation
HONNAY, O., & JACQUEMYN, H. (2007) · Conservation Biology · doi:10.1111/j.1523-1739.2006.00646.x · Cited by 457
The JBI model of evidence-based healthcare
Pearson, A., Wiechula, R., Court, A., & Lockwood, C. (2005) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1479-6988.2005.00026.x · Cited by 451
Efficacy of treatment for somatoform disorders: a review of randomized controlled trials
Kroenke, K. (2007) · Psychosomatic Medicine · doi:10.1097/psy.0b013e31815b00c4 · Cited by 450
The actor-observer asymmetry in attribution: A (surprising) meta-analysis.
Malle, B. F. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.6.895 · Cited by 450
The Efficacy and Safety of Drug Treatments for Chronic Insomnia in Adults: A Meta-Analysis of RCTs
Buscemi, N., Vandermeer, B., Friesen, C., Bialy, L., Tubman, M., Ospina, M., Klassen, T. P., & Witmans, M. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0251-z · Cited by 448
Behavioral activation treatments for depression in adults: A meta-analysis and review.
Mazzucchelli, T., Kane, R., & Rees, C. (2009) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01178.x · Cited by 438
Why review articles on the health effects of passive smoking reach different conclusions
Barnes, D. E. (1998) · JAMA · doi:10.1001/jama.279.19.1566 · Cited by 442
Meta-Analyses of Chemotherapy for Locally Advanced and Metastatic Pancreatic Cancer
Sultana, A., Smith, C. T., Cunningham, D., Starling, N., Neoptolemos, J. P., & Ghaneh, P. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2006.09.2551 · Cited by 442
Hypnotic behavior: A social-psychological interpretation of amnesia, analgesia, and “trance logic”
Spanos, N. P. (1986) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00046537 · Cited by 447
Gurevitch, J., Curtis, P. S., & Jones, M. H. (2001) · Advances in Ecological Research · doi:10.1016/s0065-2504(01)32013-5 · Cited by 421
Trock, B. J., Leonessa, F., & Clarke, R. (1997) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/89.13.917 · Cited by 434
Self-efficacy and smoking cessation: A meta-analysis.
Gwaltney, C. J., Metrik, J., Kahler, C. W., & Shiffman, S. (2009) · Psychology of Addictive Behaviors · doi:10.1037/a0013529 · Cited by 419
Hawton, K., Arensman, E., Townsend, E., Bremner, S., Feldman, E., Goldney, R., Gunnell, D., Hazell, P., van Heeringen, K., House, A., et al. (1998) · BMJ · doi:10.1136/bmj.317.7156.441 · Cited by 426
Open MEE : Intuitive, open‐source software for meta‐analysis in ecology and evolutionary biology
Wallace, B. C., Lajeunesse, M. J., Dietz, G., Dahabreh, I. J., Trikalinos, T. A., Schmid, C. H., & Gurevitch, J. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12708 · Cited by 421
A Meta-Analysis of Pedometer-Based Walking Interventions and Weight Loss
Richardson, C. R., Newton, T. L., Abraham, J. J., Sen, A., Jimbo, M., & Swartz, A. M. (2008) · The Annals of Family Medicine · doi:10.1370/afm.761 · Cited by 421
Effectiveness of Psychotherapy for Personality Disorders
Perry, J. C., Banon, E., & Ianni, F. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.9.1312 · Cited by 421
Misleading funnel plot for detection of bias in meta-analysis
Tang, J.-L., & Liu, J. L. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00204-8 · Cited by 420
Feldman, K. A. (1987) · Research in Higher Education · doi:10.1007/bf00992241 · Cited by 420
Moderators of nonverbal indicators of deception: A meta-analytic synthesis.
Sporer, S. L., & Schwandt, B. (2007) · Psychology, Public Policy, and Law · doi:10.1037/1076-8971.13.1.1 · Cited by 420
Testing and adjusting for publication bias
Møller, A. P., & Jennions, M. D. (2001) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(01)02235-2 · Cited by 418
A meta-analysis of glucocorticoids as modulators of oxidative stress in vertebrates
Costantini, D., Marasco, V., & Møller, A. P. (2011) · Journal of Comparative Physiology B · doi:10.1007/s00360-011-0566-2 · Cited by 413
A General Linear Model for Estimating Effect Size in the Presence of Publication Bias
Vevea, J. L., & Hedges, L. V. (1995) · Psychometrika · doi:10.1007/bf02294384 · Cited by 413
Social modulation of androgens in male vertebrates: meta-analyses of the challenge hypothesis
Hirschenhauser, K., & Oliveira, R. F. (2006) · Animal Behaviour · doi:10.1016/j.anbehav.2005.04.014 · Cited by 407
In-Hospital Cardiopulmonary Resuscitation
Taffet, G. E. (1988) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1988.03410140081027 · Cited by 410
Oliveira, A. S., Weinberg, Z. G., Ogunade, I. M., Cervantes, A. A. P., Arriola, K. G., Jiang, Y., Kim, D., Li, X., Gonçalves, M. C. M., Vyas, D., et al. (2017) · Journal of Dairy Science · doi:10.3168/jds.2016-11815 · Cited by 409
Semantic priming without association: A meta-analytic review
Lucas, M. (2000) · Psychonomic Bulletin & Review · doi:10.3758/bf03212999 · Cited by 408
On ‘Systematic’ Reviews of Research Literatures: A ‘narrative’ response to Evans & Benefield
Hammersley, M. (2001) · British Educational Research Journal · doi:10.1080/01411920120095726 · Cited by 407
Xing, Y., Foy, M., Cox, D. D., Kuerer, H. M., Hunt, K. K., & Cormier, J. N. (2006) · Journal of British Surgery · doi:10.1002/bjs.5209 · Cited by 402
Bonner, S. E., Hastie, R., Sprinkle, G. B., & Young, S. M. (2000) · Journal of Management Accounting Research · doi:10.2308/jmar.2000.12.1.19 · Cited by 401
Extensive reading in English as a foreign language
Mason, B., & Krashen, S. (1997) · System · doi:10.1016/s0346-251x(96)00063-2 · Cited by 401
Haykowsky, M. J., Liang, Y., Pechter, D., Jones, L. W., McAlister, F. A., & Clark, A. M. (2007) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2007.02.055 · Cited by 400
Cuijpers, P., Smit, F., Bohlmeijer, E., Hollon, S. D., & Andersson, G. (2010) · British Journal of Psychiatry · doi:10.1192/bjp.bp.109.066001 · Cited by 391
META-ANALYSIS OF SOURCES OF VARIATION IN FITNESS COSTS OF PLANT ANTIHERBIVORE DEFENSES
Koricheva, J. (2002) · Ecology · doi:10.1890/0012-9658(2002)083[0176:maosov]2.0.co;2 · Cited by 398
Lubienski, C. (2003) · American Educational Research Journal · doi:10.3102/00028312040002395 · Cited by 398
Meta-analytic procedures for combining studies with multiple effect sizes.
Rosenthal, R., & Rubin, D. B. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.99.3.400 · Cited by 394
Scientific research ontology to support systematic review in software engineering
de Almeida Biolchini, J. C., Mian, P. G., Natali, A. C. C., Conte, T. U., & Travassos, G. H. (2007) · Advanced Engineering Informatics · doi:10.1016/j.aei.2006.11.006 · Cited by 391
Insulin and Risk of Cardiovascular Disease: A Meta-Analysis
Ruige, J. B., Assendelft, W. J. J., Dekker, J. M., Kostense, P. J., Heine, R. J., & Bouter, L. M. (1998) · Circulation · doi:10.1161/01.cir.97.10.996 · Cited by 391
Montoya, R. M., Horton, R. S., Vevea, J. L., Citkowicz, M., & Lauber, E. A. (2017) · Psychological Bulletin · doi:10.1037/bul0000085 · Cited by 389
Mobile Learning projects – a critical analysis of the state of the art
Frohberg, D., Göth, C., & Schwabe, G. (2009) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2009.00315.x · Cited by 389
Palmer, A. R. (2000) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.31.1.441 · Cited by 385
Systematic Evaluation and Comparison of Statistical Tests for Publication Bias
Hayashino, Y., Noguchi, Y., & Fukui, T. (2005) · Journal of Epidemiology · doi:10.2188/jea.15.235 · Cited by 379
Carter, E. C., & McCullough, M. E. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00823 · Cited by 381
Jailwala, J., Imperiale, T. F., & Kroenke, K. (2000) · Annals of Internal Medicine · doi:10.7326/0003-4819-133-2-200007180-00013 · Cited by 381
Weingarten, E., Chen, Q., McAdams, M., Yi, J., Hepler, J., & Albarracín, D. (2016) · Psychological Bulletin · doi:10.1037/bul0000030 · Cited by 380
Klein, C., DiazGranados, D., Salas, E., Le, H., Burke, C. S., Lyons, R., & Goodwin, G. F. (2009) · Small Group Research · doi:10.1177/1046496408328821 · Cited by 377
Moreno, S. G., Sutton, A. J., Ades, A., Stanley, T. D., Abrams, K. R., Peters, J. L., & Cooper, N. J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-2 · Cited by 373
Terrestrial Trophic Cascades: How Much Do They Trickle?
Halaj, J., & Wise, D. H. (2001) · The American Naturalist · doi:10.1086/319190 · Cited by 370
Paraverbal indicators of deception: a meta‐analytic synthesis
Sporer, S. L., & Schwandt, B. (2006) · Applied Cognitive Psychology · doi:10.1002/acp.1190 · Cited by 369
Association between chromosomal instability and prognosis in colorectal cancer: a meta-analysis
Walther, A., Houlston, R., & Tomlinson, I. (2008) · Gut · doi:10.1136/gut.2007.135004 · Cited by 368
A meta‐analysis of bibliotherapy studies
Marrs, R. W. (1995) · American Journal of Community Psychology · doi:10.1007/bf02507018 · Cited by 366
Schubert, C., Hong, S., Natarajan, L., Mills, P. J., & Dimsdale, J. E. (2007) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2006.11.004 · Cited by 364
Does Tea Affect Cardiovascular Disease? A Meta-Analysis
Peters, U. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.6.495 · Cited by 364
Failure rates and associated risk factors of orthodontic miniscrew implants: A meta-analysis
Papageorgiou, S. N., Zogakis, I. P., & Papadopoulos, M. A. (2012) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2012.05.016 · Cited by 362
Han, Y., Chong, W. K., & Li, D. (2020) · International Journal of Production Research · doi:10.1080/00207543.2020.1785034 · Cited by 362
Greenland, S. (2001) · Biostatistics · doi:10.1093/biostatistics/2.4.463 · Cited by 359
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
Sedikides, C., & Gebauer, J. E. (2010) · Personality and Social Psychology Review · doi:10.1177/1088868309351002 · Cited by 358
Diener-West, M. (1992) · Archives of Ophthalmology · doi:10.1001/archopht.1992.01080140101036 · Cited by 355
Kroenke, K. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830160080011 · Cited by 355
The Results of Clinical Trials in Stroke Rehabilitation Research
Ottenbacher, K. J., & Jannell, S. (1993) · Archives of Neurology · doi:10.1001/archneur.1993.00540010033014 · Cited by 351
Mechanisms of masked priming: A meta-analysis.
Van den Bussche, E., Van den Noortgate, W., & Reynvoet, B. (2009) · Psychological Bulletin · doi:10.1037/a0015329 · Cited by 350
Nykänen, H., & Koricheva, J. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.12768.x · Cited by 350
Busch, T., & Friede, G. (2018) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.1480 · Cited by 345
A meta-analytic review of social, self-concept, and behavioral outcomes of peer-assisted learning.
Ginsburg-Block, M. D., Rohrbeck, C. A., & Fantuzzo, J. W. (2006) · Journal of Educational Psychology · doi:10.1037/0022-0663.98.4.732 · Cited by 346
College Diversity Experiences and Cognitive Development: A Meta-Analysis
Bowman, N. A. (2010) · Review of Educational Research · doi:10.3102/0034654309352495 · Cited by 346
Scott, J. M., Zabor, E. C., Schwitzer, E., Koelwyn, G. J., Adams, S. C., Nilsen, T. S., Moskowitz, C. S., Matsoukas, K., Iyengar, N. M., Dang, C. T., et al. (2018) · Journal of Clinical Oncology · doi:10.1200/jco.2017.77.5809 · Cited by 345
Metadata
- Authors
- Wilkinson, I., Light, R. J., & Pillemer, D. B.
- Venue
- Journal of Educational Statistics
- Publisher
- JSTOR
- Published
- 1987
- Volume
- 12
- Issue
- 3
- Pages
- 302
- ISSN
- 0362-9791 (ISSN-L)
- OpenAlex
- W2038886783
- Cited by
- 1,471
- References
- 0
- FWCI
- 74.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.