The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
Systematic Review and Meta-analysis: When One Study Is Just not Enough
Abstract
We live in the information age, and the practice of medicine is becoming increasingly specialized. In the biomedical literature, the number of published studies has dramatically increased: There are now more than 15 million citations in MEDLINE, with 10,000 to 20,000 new citations added each week (1). Multiple relevant studies usually guide most clinical decisions. These studies often vary in their design; methodologic quality; population studied; and the intervention, test, or condition considered. Because even highly cited trials may be challenged or refuted over time (2), clinical decision-making requires ongoing reconciliation of studies that provide different answers to the same question. Both clinicians and researchers can also benefit from a summary of where uncertainty remains. Because it is often impractical for readers to track down and review all of the primary studies (3), review articles are an important source of summarized evidence on a particular topic (4). Review articles have traditionally taken the form of a narrative review, whereby a content expert writes about a particular field, condition, or treatment (5–7). Narrative reviews have many benefits, including a broad overview of relevant information tempered by years of practical knowledge from an experienced author. Indeed, this article itself is in a narrative format, from authors who have published a number of meta-analyses in previous years. In some circumstances, a reader wants to become very knowledgeable about specific details of a topic and wants some assurance that the information presented is both comprehensive and unbiased. A narrative review typically uses an implicit process to compile evidence to support the statements being made. The reader often cannot tell which recommendations were based on the author's clinical experience, the breadth to which available literature was identified and compiled, and the reasons that some studies were given more emphasis than others. It …
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 2×
“differences in the results among the primary studies (90).”
ResultPublication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Cited by
Alhazzani, W., Møller, M. H., Arabi, Y. M., Loeb, M., Gong, M. N., Fan, E., Oczkowski, S., Levy, M. M., Derde, L., Dzierba, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06022-5 · Cited by 2,105
Interpretation of the evidence for the efficacy and safety of statin therapy
Collins, R., Reith, C., Emberson, J., Armitage, J., Baigent, C., Blackwell, L., Blumenthal, R., Danesh, J., Smith, G. D., DeMets, D., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31357-5 · Cited by 1,857
Standards of Medical Care in Diabetes—2008
American Diabetes Association (2008) · Diabetes Care · doi:10.2337/dc08-s012 · Cited by 1,377
Epigenetic Signatures of Cigarette Smoking
Joehanes, R., Just, A. C., Marioni, R. E., Pilling, L. C., Reynolds, L. M., Mandaviya, P. R., Guan, W., Xu, T., Elks, C. E., Aslibekyan, S., et al. (2016) · Circulation: Cardiovascular Genetics · doi:10.1161/circgenetics.116.001506 · Cited by 929
Prolonged operative duration is associated with complications: a systematic review and meta-analysis
Cheng, H., Clymer, J. W., Po-Han Chen, B., Sadeghirad, B., Ferko, N. C., Cameron, C. G., & Hinoul, P. (2018) · Journal of Surgical Research · doi:10.1016/j.jss.2018.03.022 · Cited by 913
Mantyka‐pringle, C. S., Martin, T. G., & Rhodes, J. R. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2011.02593.x · Cited by 742
Mancia, G., Fagard, R., Narkiewicz, K., Redon, J., Zanchetti, A., Böhm, M., Christiaens, T., Cifkova, R., De Backer, G., Dominiczak, A., et al. (2014) · Blood Pressure · doi:10.3109/08037051.2014.868629 · Cited by 739
Mapping global prevalence of depression among postpartum women
Wang, Z., Liu, J., Shuai, H., Cai, Z., Fu, X., Liu, Y., Xiao, X., Zhang, W., Krabbendam, E., Liu, S., et al. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01663-6 · Cited by 734
Applying principles of behaviour change to reduce SARS-CoV-2 transmission
West, R., Michie, S., Rubin, G. J., & Amlôt, R. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0887-9 · Cited by 658
Lovato, N., & Gradisar, M. (2014) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2014.03.006 · Cited by 594
Luque-Suarez, A., Martinez-Calderon, J., & Falla, D. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098673 · Cited by 546
Hossain, M. M., Khan, N., Sultana, A., Ma, P., McKyer, E. L. J., Ahmed, H. U., & Purohit, N. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112922 · Cited by 504
Wollenberg, A., Christen‐Zäch, S., Taieb, A., Paul, C., Thyssen, J. P., de Bruin‐Weller, M., Vestergaard, C., Seneschal, J., Werfel, T., Cork, M. J., et al. (2020) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.16892 · Cited by 493
Meta-analysis of data from animal studies: A practical guide
Vesterinen, H. M., Sena, E. S., Egan, K. J., Hirst, T. C., Churolov, L., Currie, G. L., Antonic, A., Howells, D. W., & Macleod, M. R. (2014) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.09.010 · Cited by 488
The impact of crop rotation on soil microbial diversity: A meta-analysis
Venter, Z. S., Jacobs, K., & Hawkins, H.-J. (2016) · Pedobiologia · doi:10.1016/j.pedobi.2016.04.001 · Cited by 467
Obesity and the risk of cardiometabolic diseases
Valenzuela, P. L., Carrera-Bastos, P., Castillo-García, A., Lieberman, D. E., Santos-Lozano, A., & Lucia, A. (2023) · Nature Reviews Cardiology · doi:10.1038/s41569-023-00847-5 · Cited by 452
NCCN Task Force Report: Bone Health in Cancer Care
Gralow, J. R., Biermann, J. S., Farooki, A., Fornier, M. N., Gagel, R. F., Kumar, R., Litsas, G., McKay, R., Podoloff, D. A., Srinivas, S., et al. (2013) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2013.0215 · Cited by 412
Network meta-analysis: a technique to gather evidence from direct and indirect comparisons
Tonin, F. S., Rotta, I., Mendes, A. M., & Pontarolo, R. (2017) · Pharmacy Practice · doi:10.18549/pharmpract.2017.01.943 · Cited by 405
Jenab, M., Bueno-de-Mesquita, H. B., Ferrari, P., van Duijnhoven, F. J. B., Norat, T., Pischon, T., Jansen, E. H. J. M., Slimani, N., Byrnes, G., Rinaldi, S., et al. (2010) · BMJ · doi:10.1136/bmj.b5500 · Cited by 404
Davies, T. F., Andersen, S., Latif, R., Nagayama, Y., Barbesino, G., Brito, M., Eckstein, A. K., Stagnaro-Green, A., & Kahaly, G. J. (2020) · Nature Reviews Disease Primers · doi:10.1038/s41572-020-0184-y · Cited by 398
Review Article: Vulnerability to Heat-related Mortality
Benmarhnia, T., Deguen, S., Kaufman, J. S., & Smargiassi, A. (2015) · Epidemiology · doi:10.1097/ede.0000000000000375 · Cited by 396
Gili, M., Castellví, P., Vives, M., de la Torre-Luque, A., Almenara, J., Blasco, M. J., Cebrià, A. I., Gabilondo, A., Pérez-Ara, M. A., A, M.-M., et al. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.10.115 · Cited by 365
Alzheimer's Disease Genetics Consortium, Whitcomb, D. C., LaRusch, J., Krasinskas, A. M., Klei, L., Smith, J. P., Brand, R. E., Neoptolemos, J. P., Lerch, M. M., Tector, M., et al. (2012) · Nature Genetics · doi:10.1038/ng.2466 · Cited by 357
The role of alcohol and smoking in pancreatitis
Yadav, D., & Whitcomb, D. C. (2010) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/nrgastro.2010.6 · Cited by 313
Nutrition and physical activity in NAFLD: An overview of the epidemiological evidence
Zelber-Sagi, S. (2011) · World Journal of Gastroenterology · doi:10.3748/wjg.v17.i29.3377 · Cited by 300
A Comparative Study of the ADDIE Instructional Design Model in Distance Education
Spatioti, A. G., Kazanidis, I., & Pange, J. (2022) · Information · doi:10.3390/info13090402 · Cited by 689
An initial meta-analysis of acceptance and commitment therapy for treating substance use disorders
Lee, E. B., An, W., Levin, M. E., & Twohig, M. P. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.08.004 · Cited by 271
Implementation of lean practices in the construction industry: A systematic review
Babalola, O., Ibem, E. O., & Ezema, I. C. (2019) · Building and Environment · doi:10.1016/j.buildenv.2018.10.051 · Cited by 270
Cheung, C. H. M., Bedford, R., Saez De Urabain, I. R., Karmiloff-Smith, A., & Smith, T. J. (2017) · Scientific Reports · doi:10.1038/srep46104 · Cited by 264
Revilla‐León, M., Subramanian, S. G., Özcan, M., & Krishnamurthy, V. R. (2020) · Journal of Prosthodontics · doi:10.1111/jopr.13135 · Cited by 268
Cognitive behavioral therapy for the treatment of post-traumatic stress disorder: A review
Kar, N. (2011) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s10389 · Cited by 266
Sena, E. S., Currie, G. L., McCann, S. K., Macleod, M. R., & Howells, D. W. (2014) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2014.28 · Cited by 264
Steinhoff, M., Suárez, A., Feramisco, J., & Koo, J. (2012) · Acta Dermato Venereologica · doi:10.2340/00015555-1188 · Cited by 263
Extracorporeal cardiopulmonary resuscitation in adults: evidence and implications
Abrams, D., MacLaren, G., Lorusso, R., Price, S., Yannopoulos, D., Vercaemst, L., Bělohlávek, J., Taccone, F. S., Aissaoui, N., Shekar, K., et al. (2022) · Intensive Care Medicine · doi:10.1007/s00134-021-06514-y · Cited by 261
Alcoholic disease: Liver and beyond
Rocco, A. (2014) · World Journal of Gastroenterology · doi:10.3748/wjg.v20.i40.14652 · Cited by 258
Dror, D. M., Hossain, S. A. S., Majumdar, A., Pérez Koehlmoos, T. L., John, D., & Panda, P. K. (2016) · PLOS ONE · doi:10.1371/journal.pone.0160479 · Cited by 255
Short-Physical Performance Battery (SPPB) score is associated with falls in older outpatients
Lauretani, F., Ticinesi, A., Gionti, L., Prati, B., Nouvenne, A., Tana, C., Meschi, T., & Maggio, M. (2019) · Aging Clinical and Experimental Research · doi:10.1007/s40520-018-1082-y · Cited by 211
Hermsen, S., Frost, J., Renes, R. J., & Kerkhof, P. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.12.023 · Cited by 194
Miranda-Mendizábal, A., Castellví, P., Parés-Badell, O., Almenara, J., Alonso, I., Blasco, M. J., Cebrià, A., Gabilondo, A., Gili, M., Lagares, C., et al. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.196345 · Cited by 188
Blakey, S. M., & Abramowitz, J. S. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.07.002 · Cited by 200
Astrup, A., & Bügel, S. (2019) · International Journal of Obesity · doi:10.1038/s41366-018-0143-9 · Cited by 179
A narrative review of alcohol consumption as a risk factor for global burden of disease
Rehm, J., & Imtiaz, S. (2016) · Substance Abuse Treatment, Prevention, and Policy · doi:10.1186/s13011-016-0081-2 · Cited by 177
Kim, M. K., Baek, K. H., Song, K.-H., Il Kang, M., Park, C. Y., Lee, W. Y., & Oh, K. W. (2011) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-1602 · Cited by 171
Fortuna, K. L., Solomon, P., & Rivera, J. (2022) · Psychiatric Quarterly · doi:10.1007/s11126-022-09971-w · Cited by 167
Kehoe, T., Gmel, G., Shield, K. D., Gmel, G., & Rehm, J. (2012) · Population Health Metrics · doi:10.1186/1478-7954-10-6 · Cited by 160
Towards a new model of attentional biases in the development, maintenance, and management of pain
Todd, J., Sharpe, L., Johnson, A., Nicholson Perry, K., Colagiuri, B., & Dear, B. F. (2015) · Pain · doi:10.1097/j.pain.0000000000000214 · Cited by 156
Pelsser, L. M., Frankena, K., Toorman, J., & Rodrigues Pereira, R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0169277 · Cited by 145
Gobeil, R., Blanchette, K., & Stewart, L. (2016) · Criminal Justice and Behavior · doi:10.1177/0093854815621100 · Cited by 142
Psychological interventions in the treatment of chronic itch
Schut, C., Mollanazar, N., Kupfer, J., Gieler, U., & Yosipovitch, G. (2016) · Acta Dermato-Venereologica · doi:10.2340/00015555-2177 · Cited by 119
Aligning software engineering education with industrial needs: A meta-analysis
Garousi, V., Giray, G., Tüzün, E., Catal, C., & Felderer, M. (2019) · Journal of Systems and Software · doi:10.1016/j.jss.2019.06.044 · Cited by 119
AI-based learning style detection in adaptive learning systems: a systematic literature review
Ezzaim, A., Dahbi, A., Aqqal, A., & Haidine, A. (2025) · Journal of Computers in Education · doi:10.1007/s40692-024-00328-9 · Cited by 109
The association of overjet size and traumatic dental injuries—A systematic review and meta-analysis
Arraj, G. P., Rossi‐Fedele, G., & Doğramacı, E. J. (2019) · Dental Traumatology · doi:10.1111/edt.12481 · Cited by 103
Schwarzinger, M., Thiébaut, S. P., Baillot, S., Mallet, V., & Rehm, J. (2018) · BMC Public Health · doi:10.1186/s12889-017-4587-y · Cited by 94
Association of venous thromboembolism with hormonal contraception and thrombophilic genotypes
Bergendal, A., Persson, I., Odeberg, J., Sundström, A., Holmström, M., Schulman, S., Björgell, O., & Kieler, H. (2014) · Obstetrics & Gynecology · doi:10.1097/aog.0000000000000411 · Cited by 93
Alcohol Intake Revisited: Risks and Benefits
Roerecke, M., & Rehm, J. (2012) · Current Atherosclerosis Reports · doi:10.1007/s11883-012-0277-5 · Cited by 58
Pearson, J., Giacumo, L. A., Farid, A., & Sadegh, M. (2022) · Education Sciences · doi:10.3390/educsci12050333 · Cited by 51
Ivanova, O., Martínez‐Nicolás, I., & Meilán, J. J. G. (2024) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12888 · Cited by 38
van de Leur, J. C., Buhrman, M., Åhs, F., Rozental, A., & Jansen, G. B. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02907-3 · Cited by 30
Interventions to increase physical activity in children aged 2-5 years: a systematic review
Ling, J., Robbins, L. B., Wen, F., & Peng, W. (2015) · Pediatric Exercise Science · doi:10.1123/pes.2014-0148 · Cited by 28
Tak, L. M., Meijer, A., Manoharan, A., de Jonge, P., & Rosmalen, J. G. M. (2010) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181d714e1 · Cited by 23
Brun, J.-F., Varlet-Marie, E., Jrme, A., & Mercier, J. (2012) · An International Perspective on Topics in Sports Medicine and Sports Injury · doi:10.5772/25451 · Cited by 19
Skilbeck, M. G., Mei, L., Mohammed, H., Cannon, R. D., & Farella, M. (2022) · Orthodontics & Craniofacial Research · doi:10.1111/ocr.12503 · Cited by 18
Paras, T., Sabzevari, S., Solomon, D., Smith, C., McDonough, C., & Lin, A. (2022) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671221121330 · Cited by 13
Wang, D., Li, W., Yin, L., Du, Y., Zhang, S., & Suo, J. (2020) · Oncology Letters · doi:10.3892/ol.2020.11350 · Cited by 12
Bagnall, A.-M., South, J., Kinsella, K., Trigwell, J., Sheridan, K., & Harden, A. (2025) · BMC Public Health · doi:10.1186/s12889-025-21902-5 · Cited by 11
Insulin pump complications among children with diabetes
Hou, M., Amed, S., & Goldman, R. D. (2022) · Canadian Family Physician · doi:10.46747/cfp.6812893 · Cited by 10
Elkordy, S. A., Palomo, L., Palomo, J. M., & Mostafa, Y. A. (2019) · Seminars in Orthodontics · doi:10.1053/j.sodo.2019.05.005 · Cited by 10
Metadata
- Authors
- Garg, A. X., Hackam, D., & Tonelli, M.
- Venue
- Clinical Journal of the American Society of Nephrology
- Published
- 2008-01
- Volume
- 3
- Issue
- 1
- Pages
- 253-260
- ISSN
- 1555-9041 (ISSN-L)
- OpenAlex
- W2126468223
- Cited by
- 2,258
- References
- 98
- FWCI
- 26.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.