The DOI matches its Crossref record.
Summing up: The Science of Reviewing Research
Abstract
1. Introduction 2. Organizing a Reviewing Strategy 3. Quantitative Procedures 4. Numbers and Narrative: The Division of Labor 5. What We Have Learned 6. A Checklist for Evaluating Reviews Reference Index
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Items 201–300 of 329
Infant Feeding and Blood Cholesterol: A Study in Adolescents and a Systematic Review
Owen, C. G., Whincup, P. H., Odoki, K., Gilg, J. A., & Cook, D. G. (2002) · Pediatrics · doi:10.1542/peds.110.3.597 · Cited by 340
A Meta-Analysis of Rates of Return to Agricultural R&D:Ex Pede Herculem?
(2000) · International Food Policy Research Institute eBooks · doi:10.2499/0896291162rr113 · Cited by 339
Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis
van Aert, R. C. M., Wicherts, J. M., & van Assen, M. A. L. M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0215052 · Cited by 334
A conceptual framework for systematic reviews of research in educational leadership and management
Hallinger, P. (2013) · Journal of Educational Administration · doi:10.1108/09578231311304670 · Cited by 332
Wheeler, J. A., Gorey, K. M., & Greenblatt, B. (1998) · The International Journal of Aging and Human Development · doi:10.2190/vump-xcmf-fqyu-v0jh · Cited by 331
The Think-Aloud Controversy in Second Language Research
Bowles, M. A. (2010) · Routledge eBooks · doi:10.4324/9780203856338 · Cited by 330
Career-intervention outcome: What contributes to client gain?
Oliver, L. W., & Spokane, A. R. (1988) · Journal of Counseling Psychology · doi:10.1037//0022-0167.35.4.447 · Cited by 330
Vigerland, S., Lenhard, F., Bonnert, M., Lalouni, M., Hedman, E., Ahlen, J., Olén, O., Serlachius, E., & Ljótsson, B. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.09.005 · Cited by 292
Patriarchal ideology and wife-assault: A meta-analytic review
Sugarman, D. B., & Frankel, S. L. (1996) · Journal of Family Violence · doi:10.1007/bf02333338 · Cited by 326
Bt Crop Effects on Functional Guilds of Non-Target Arthropods: A Meta-Analysis
Wolfenbarger, L. L., Naranjo, S. E., Lundgren, J. G., Bitzer, R. J., & Watrud, L. S. (2008) · PLoS ONE · doi:10.1371/journal.pone.0002118 · Cited by 324
Ultrasound guidance versus anatomical landmarks for subclavian or femoral vein catheterization
Brass, P., Hellmich, M., Kolodziej, L., Schick, G., & Smith, A. F. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011447 · Cited by 320
Behavioral activation interventions for well-being: A meta-analysis
Mazzucchelli, T. G., Kane, R. T., & Rees, C. S. (2010) · The Journal of Positive Psychology · doi:10.1080/17439760903569154 · Cited by 319
A Meta-Analytic Review of Stand-Alone Interventions to Improve Body Image
Alleva, J. M., Sheeran, P., Webb, T. L., Martijn, C., & Miles, E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0139177 · Cited by 319
Enduring and different: A meta-analysis of the similarity in parents' child rearing.
Holden, G. W., & Miller, P. C. (1999) · Psychological Bulletin · doi:10.1037//0033-2909.125.2.223 · Cited by 317
Álvarez-Jiménez, M., Hetrick, S. E., González-Blanch, C., Gleeson, J. F., & McGorry, P. D. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.042853 · Cited by 317
Pietschnig, J., Penke, L., Wicherts, J. M., Zeiler, M., & Voracek, M. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.09.017 · Cited by 316
Advancements in Research Synthesis Methods: From a Methodologically Inclusive Perspective
Suri, H., & Clarke, D. (2009) · Review of Educational Research · doi:10.3102/0034654308326349 · Cited by 316
Meta-analysis: Chondroitin for Osteoarthritis of the Knee or Hip
Reichenbach, S., Sterchi, R., Scherer, M., Trelle, S., Bürgi, E., Bürgi, U., Dieppe, P. A., & Jüni, P. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-8-200704170-00009 · Cited by 316
Attention bias modification for social anxiety: A systematic review and meta-analysis
Heeren, A., Mogoașe, C., Philippot, P., & McNally, R. J. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.06.001 · Cited by 312
Mishara, A. L., & Goldberg, T. E. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.01.027 · Cited by 310
Updated tests for small-study effects in meta-analyses
Harbord, R. M., Harris, R. J., & Sterne, J. A. C. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900202 · Cited by 307
Bowman, N. A. (2011) · Review of Educational Research · doi:10.3102/0034654310383047 · Cited by 307
Ambient Air Pollution and Risk of Congenital Anomalies: A Systematic Review and Meta-analysis
Vrijheid, M., Martinez, D., Manzanares, S., Dadvand, P., Schembari, A., Rankin, J., & Nieuwenhuijsen, M. (2011) · Environmental Health Perspectives · doi:10.1289/ehp.1002946 · Cited by 305
The distance dependence prediction of the Janzen‐Connell hypothesis: a meta‐analysis
Hyatt, L. A., Rosenberg, M. S., Howard, T. G., Bole, G., Fang, W., Anastasia, J., Brown, K., Grella, R., Hinman, K., Kurdziel, J. P., et al. (2003) · Oikos · doi:10.1034/j.1600-0706.2003.12235.x · Cited by 305
Effects of media violence on viewers' aggression in unconstrained social interaction.
Wood, W., Wong, F. Y., & Chachere, J. G. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.109.3.371 · Cited by 303
How important are direct fitness benefits of sexual selection?
Møller, A., & Jennions, M. (2001) · Naturwissenschaften · doi:10.1007/s001140100255 · Cited by 303
Relation of the alliance with outcomes in youth psychotherapy: a meta-analysis
McLeod, B. D. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.02.001 · Cited by 301
VRANCKX, G., JACQUEMYN, H., MUYS, B., & HONNAY, O. (2012) · Conservation Biology · doi:10.1111/j.1523-1739.2011.01778.x · Cited by 302
Sargent, D. J. (2001) · Cancer · doi:10.1002/1097-0142(20010415)91:8+<1636::aid-cncr1176>3.0.co;2-d · Cited by 302
Endogenous testosterone and cardiovascular disease in healthy men: a meta-analysis
Ruige, J. B., Mahmoud, A. M., De Bacquer, D., & Kaufman, J.-M. (2011) · Heart · doi:10.1136/hrt.2010.210757 · Cited by 302
Rösner, S., Leucht, S., Lehert, P., & Soyka, M. (2008) · Journal of Psychopharmacology · doi:10.1177/0269881107078308 · Cited by 300
The Relationship of Self-Efficacy Appraisals to Subsequent Health Related Outcomes: A Meta-Analysis
Holden, G. (1992) · Social Work in Health Care · doi:10.1300/j010v16n01_05 · Cited by 297
Page, M. J., Sterne, J. A. C., Higgins, J. P. T., & Egger, M. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1468 · Cited by 294
Transformational School Leadership
Leithwood, K., Tomlinson, D., & Genge, M. (1996) · International Handbook of Educational Leadership and Administration · doi:10.1007/978-94-009-1573-2_23 · Cited by 294
RATES OF VENOUS THROMBOSIS AFTER GENERAL SURGERY: COMBINED RESULTS OF RANDOMISED CLINICAL TRIALS
Colditz, G., Tuden, R., & Oster, G. (1986) · The Lancet · doi:10.1016/s0140-6736(86)91955-0 · Cited by 290
Writing the Proposal for a Qualitative Research Methodology Project
Sandelowski, M., & Barroso, J. (2003) · Qualitative Health Research · doi:10.1177/1049732303013006003 · Cited by 290
Differences between novice and experienced users in searching information on the World Wide Web
Lazonder, A. W., Biemans, H. J. A., & Wopereis, I. G. J. H. (2000) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(2000)51:6<576::aid-asi9>3.0.co;2-7 · Cited by 289
Modelling publication bias in meta-analysis: a review
Sutton, A. J., Song, F., Gilbody, S. M., & Abrams, K. R. (2000) · Statistical Methods in Medical Research · doi:10.1177/096228020000900503 · Cited by 288
Kratochwill, T. R., & Stoiber, K. C. (2002) · School Psychology Quarterly · doi:10.1521/scpq.17.4.341.20872 · Cited by 288
Venkatachalapathy, S., Sundararaj, D., Tandon, A., & Pereira, A. (2015) · Journal of International Society of Preventive and Community Dentistry · doi:10.4103/2231-0762.167719 · Cited by 287
An Association between the Risk of Cancer and Mutations in the HRAS1 Minisatellite Locus
Krontiris, T. G., Devlin, B., Karp, D. D., Robert, N. J., & Risch, N. (1993) · New England Journal of Medicine · doi:10.1056/nejm199308193290801 · Cited by 287
YOUNG PEOPLE AND PHYSICAL ACTIVITY
Armstrong, N., Welsman, J. R., Beunen, G., Kemper, H. C. G., & Van Praagh, E. (1999) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-199905001-01442 · Cited by 286
Miao, C., Qian, S., & Ma, D. (2017) · Journal of Small Business Management · doi:10.1111/jsbm.12240 · Cited by 286
The impact of background music on adult listeners: A meta-analysis
Kämpfe, J., Sedlmeier, P., & Renkewitz, F. (2011) · Psychology of Music · doi:10.1177/0305735610376261 · Cited by 285
A practitioner's guide to meta‐analysis
Durlak, J. A., & Lipsey, M. W. (1991) · American Journal of Community Psychology · doi:10.1007/bf00938026 · Cited by 284
Gerber, A., & Malhotra, N. (2008) · Quarterly Journal of Political Science · doi:10.1561/100.00008024 · Cited by 284
Agreement among reviewers of review articles
Oxman, A. D., Guyatt, G. H., Singer, J., Goldsmith, C. H., Hutchison, B. G., Milner, R. A., & Streiner, D. L. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90205-n · Cited by 282
Meta-analysis of public transport demand
Holmgren, J. (2007) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2007.06.003 · Cited by 279
Understanding the Third-Person Perception: Evidence From a Meta-Analysis
Sun, Y., Pan, Z., & Shen, L. (2008) · Journal of Communication · doi:10.1111/j.1460-2466.2008.00385.x · Cited by 276
Effect of Exercise Training on Peak Oxygen Consumption in Patients with Cancer: A Meta-Analysis
Jones, L. W., Liang, Y., Pituskin, E. N., Battaglini, C. L., Scott, J. M., Hornsby, W. E., & Haykowsky, M. (2011) · The Oncologist · doi:10.1634/theoncologist.2010-0197 · Cited by 276
E-fulfilment and distribution in omni-channel retailing: a systematic literature review
Melacini, M., Perotti, S., Rasini, M., & Tappia, E. (2018) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/ijpdlm-02-2017-0101 · Cited by 275
Publication bias: what is it? How do we measure it? How do we avoid it?
Song, F., Hooper, & Loke, Y. (2013) · Open Access Journal of Clinical Trials · doi:10.2147/oajct.s34419 · Cited by 275
Klassen, J. A., Liang, Y., Tjosvold, L., Klassen, T. P., & Hartling, L. (2008) · Ambulatory Pediatrics · doi:10.1016/j.ambp.2007.12.005 · Cited by 272
Self-Compassion and Coping: a Meta-Analysis
Ewert, C., Vater, A., & Schröder-Abé, M. (2021) · Mindfulness · doi:10.1007/s12671-020-01563-8 · Cited by 270
Angeloni, F., Ouborg, N. J., & Leimu, R. (2011) · Biological Conservation · doi:10.1016/j.biocon.2010.08.016 · Cited by 271
Empirical bayes meta-analysis.
Raudenbush, S. W., & Bryk, A. S. (1985) · Journal of Educational Statistics · doi:10.3102/10769986010002075 · Cited by 299
Gligor, D., Gligor, N., Holcomb, M., & Bozkurt, S. (2019) · The International Journal of Logistics Management · doi:10.1108/ijlm-10-2017-0259 · Cited by 267
Felson, D., & Anderson, J. (1987) · The Lancet · doi:10.1016/s0140-6736(87)92870-4 · Cited by 267
Bailey, J. K., Schweitzer, J. A., Úbeda, F., Koricheva, J., LeRoy, C. J., Madritch, M. D., Rehill, B. J., Bangert, R. K., Fischer, D. G., Allan, G. J., et al. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0336 · Cited by 266
Meta-analysis using effect size distributions of only statistically significant studies.
van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2015) · Psychological Methods · doi:10.1037/met0000025 · Cited by 265
Palmer, A. R. (1999) · The American Naturalist · doi:10.1086/303223 · Cited by 264
de Vries, R. B. M., Hooijmans, C. R., Langendam, M. W., van Luijk, J., Leenaars, M., Ritskes‐Hoitinga, M., & Wever, K. E. (2015) · Evidence-based Preclinical Medicine · doi:10.1002/ebm2.7 · Cited by 264
RESEARCH SYNTHESIS AS A SCIENTIFIC PROCESS
COOPER, H., HEDGES, L. V., & VALENTINE, J. C. (2019) · The Handbook of Research Synthesis and Meta-Analysis · doi:10.7758/9781610448864.4 · Cited by 263
The Latitudinal Gradient in Niche Breadth: Concepts and Evidence
Vázquez, D. P., & Stevens, R. D. (2004) · The American Naturalist · doi:10.1086/421445 · Cited by 262
Signals or Noise? Explaining the Variation in Recreation Benefit Estimates
Smith, V. K., & Kaoru, Y. (1990) · American Journal of Agricultural Economics · doi:10.2307/1242344 · Cited by 262
A Systematic Review of the Religiosity and Delinquency Literature: A Research Note
JOHNSON, B. R., De LI, S., LARSON, D. B., & McCULLOUGH, M. (2000) · Journal of Contemporary Criminal Justice · doi:10.1177/1043986200016001003 · Cited by 261
Hartling, L., Liang, Y., & Lacaze-Masmonteil, T. (2012) · Archives of Disease in Childhood - Fetal and Neonatal Edition · doi:10.1136/adc.2010.210187 · Cited by 260
Stahl, S. A., & Miller, P. D. (1989) · Review of Educational Research · doi:10.2307/1170448 · Cited by 260
Elkis, H. (1995) · Archives of General Psychiatry · doi:10.1001/archpsyc.1995.03950210029008 · Cited by 259
Assessment of the quality of meta-analysis in agronomy
Philibert, A., Loyce, C., & Makowski, D. (2012) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2011.12.003 · Cited by 259
Melanin- versus carotenoid-based sexual signals: is the difference really so black and red?
Griffith, S. C., Parker, T. H., & Olson, V. A. (2006) · Animal Behaviour · doi:10.1016/j.anbehav.2005.07.016 · Cited by 258
Invited review: Use of meta-analysis in animal health and reproduction: Methods and applications
Lean, I. J., Rabiee, A. R., Duffield, T. F., & Dohoo, I. R. (2009) · Journal of Dairy Science · doi:10.3168/jds.2009-2140 · Cited by 257
Timing of perioperative antibiotics for cesarean delivery: a metaanalysis
Costantine, M. M., Rahman, M., Ghulmiyah, L., Byers, B. D., Longo, M., Wen, T., Hankins, G. D. V., & Saade, G. R. (2008) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2008.06.077 · Cited by 257
Allen, C. S., Chen, Q., Willson, V. L., & Hughes, J. N. (2009) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373709352239 · Cited by 257
Identifying Teacher Expertise: An Examination of Researchers' Decision Making
Palmer, D. J., Stough, L. M., Burdenski, Jr., & Gonzales, M. (2005) · Educational Psychologist · doi:10.1207/s15326985ep4001_2 · Cited by 256
Jennions, M. D., & Møller, A. P. (2002) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.2001.1832 · Cited by 255
Veenhoven, R. (2004) · Social Indicators Research Series · doi:10.1007/978-1-4020-2903-5_6 · Cited by 254
Methods for Exploring Heterogeneity in Meta-Analysis
Song, F., Sheldon, T. A., Sutton, A. J., Abrams, K. R., & Jones, D. R. (2001) · Evaluation & the Health Professions · doi:10.1177/01632780122034849 · Cited by 253
“To be of use”: enhancing the utility of qualitative research
Sandelowski, M. (1997) · Nursing Outlook · doi:10.1016/s0029-6554(97)90043-9 · Cited by 247
Neuron loss in key cholinergic and aminergic nuclei in Alzheimer disease: a meta-analysis
Lyness, S. (2003) · Neurobiology of Aging · doi:10.1016/s0197-4580(02)00057-x · Cited by 240
VISUAL INPUT ENHANCEMENT AND GRAMMAR LEARNING: A Meta-Analytic Review
Lee, S.-K., & Huang, H.-T. (2008) · Studies in Second Language Acquisition · doi:10.1017/s0272263108080479 · Cited by 238
Miles, P. G., Vig, P. S., Weyant, R. J., Forrest, T. D., & Rockette, H. E. (1996) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/s0889-5406(96)70177-4 · Cited by 237
Carlucci, L., Saggino, A., & Balsamo, M. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.101999 · Cited by 234
Graphical displays for meta-analysis: An overview with suggestions for practice
Anzures‐Cabrera, J., & Higgins, J. P. T. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.6 · Cited by 233
Publication bias in ecology and evolution: an empirical assessment using the ‘trim and fill’ method
JENNIONS, M. D., & MØLLER, A. P. (2002) · Biological Reviews · doi:10.1017/s1464793101005875 · Cited by 230
Chen, Y.-R., Hung, K.-W., Tsai, J.-C., Chu, H., Chung, M.-H., Chen, S.-R., Liao, Y.-M., Ou, K.-L., Chang, Y.-C., & Chou, K.-R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0103676 · Cited by 222
Publication bias as a threat to the validity of meta-analytic results
Rothstein, H. R. (2008) · Journal of Experimental Criminology · doi:10.1007/s11292-007-9046-9 · Cited by 216
Moving from cognition to behavior: What the research says.
Johnson, R. E., Chang, C.-H., & Lord, R. G. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.381 · Cited by 193
Accounting for heterogeneity via random-effects models and moderator analyses in meta-analysis.
Viechtbauer, W. (2007) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.215.2.104 · Cited by 193
Borenstein, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch11 · Cited by 178
Liu, J., Zhao, S., Chen, X., Falk, E., & Albarracín, D. (2017) · Psychological Bulletin · doi:10.1037/bul0000113 · Cited by 176
A meta‐analysis of coffee, myocardial infarction, and coronary death
Greenland, S. (1993) · Epidemiology · doi:10.1097/00001648-199307000-00013 · Cited by 163
Environmental exposure to asbestos and risk of pleural mesothelioma: review and meta-analysis
Bourdès, V., Boffetta, P., & Pisani, P. (2000) · European Journal of Epidemiology · doi:10.1023/a:1007691003600 · Cited by 157
Nam, I., Mengersen, K., & Garthwaite, P. (2003) · Statistics in Medicine · doi:10.1002/sim.1410 · Cited by 153
The expectation effect and cardiac pacing for refractory vasovagal syncope
Sud, S., Massel, D., Klein, G. J., Leong-Sit, P., Yee, R., Skanes, A. C., Gula, L. J., & Krahn, A. D. (2007) · The American Journal of Medicine · doi:10.1016/j.amjmed.2006.05.046 · Cited by 151
Dybvik, J. S., Svendsen, M., & Aune, D. (2023) · European Journal of Nutrition · doi:10.1007/s00394-022-02942-8 · Cited by 150
The effect of problem-based learning in nursing education: a meta-analysis
Shin, I.-S., & Kim, J.-H. (2013) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9436-2 · Cited by 149
Pearson, N., Braithwaite, R., & Biddle, S. J. H. (2015) · Academic Pediatrics · doi:10.1016/j.acap.2014.08.009 · Cited by 149
Evidence-Based Research Series-Paper 1: What Evidence-Based Research is and why is it important?
Robinson, K. A., Brunnhuber, K., Ciliska, D., Juhl, C. B., Christensen, R., & Lund, H. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.07.020 · Cited by 146
Kraemer, H. C., Gardner, C., Brooks, J. O., & Yesavage, J. A. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.1.23 · Cited by 141
Metadata
- Authors
- Wilkinson, I., Light, R. J., & Pillemer, D. B.
- Venue
- Journal of Educational Statistics
- Publisher
- JSTOR
- Published
- 1987
- Volume
- 12
- Issue
- 3
- Pages
- 302
- ISSN
- 0362-9791 (ISSN-L)
- OpenAlex
- W2038886783
- Cited by
- 1,471
- References
- 0
- FWCI
- 74.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.