Systematic Reviews to Support Evidence-Based Medicine: How to appraise, conduct and publish reviews
The DOI matches its Crossref record.
Abstract
As our current healthcare practice and policy increasingly relies on clear and comprehensive summaries of information collated through systematic literature reviews, it is necessary for us to understand how reviews and practice guidelines are produced. You may not be trained in health research methods, but this book will enable you to grasp the principles behind reviewing literature. In this way you will be able to critically appraise published systematic reviews and guidelines, and evaluate their inferences and recommendations for application in your practice. Published reviews and guidelines are not always adequate or sufficient for our needs. Have you ever wondered how you could conduct your own review? The resources required for undertaking reviews are increasingly becoming available in a clinical setting. The appointment of clinical librarians, internet access to many journals, ease of obtaining interlibrary loans and the availability of user-friendly software make it possible for systematic reviews to be conducted by healthcare practitioners. This book highlights the core information necessary for planning and preparing reviews. It focuses on a clinical readership and new reviewers, not on experienced epidemiologists, social scientists, medical educationalists and statisticians. Using this book you will be able to initiate your own review.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Evidence syntheses based on RCTs generate the strongest possible recommendations and practice guidelines.3,4”
From Integrity of randomized clinical trials: Performance of integrity tests and checklists requires assessment (2023) · cites this paper as [4]
Citations
Cites
Still being checked.
Cited by
Urban greening to cool towns and cities: A systematic review of the empirical evidence
Bowler, D. E., Buyung-Ali, L., Knight, T. M., & Pullin, A. S. (2010) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2010.05.006 · Cited by 3,099
A systematic review of evidence for the added benefits to health of exposure to natural environments
Bowler, D. E., Buyung-Ali, L. M., Knight, T. M., & Pullin, A. S. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-456 · Cited by 1,993
Systematic literature reviews in software engineering – A tertiary study
Kitchenham, B., Pretorius, R., Budgen, D., Pearl Brereton, O., Turner, M., Niazi, M., & Linkman, S. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.03.006 · Cited by 1,230
Using mapping studies as the basis for further research – A participant-observer case study
Kitchenham, B. A., Budgen, D., & Pearl Brereton, O. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2010.12.011 · Cited by 621
Arcuri, A., & Briand, L. (2014) · Software Testing, Verification and Reliability · doi:10.1002/stvr.1486 · Cited by 622
Music as an aid for postoperative recovery in adults: a systematic review and meta-analysis
Hole, J., Hirsch, M., Ball, E., & Meads, C. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60169-6 · Cited by 597
Risk models and scores for type 2 diabetes: systematic review
Noble, D., Mathur, R., Dent, T., Meads, C., & Greenhalgh, T. (2011) · BMJ · doi:10.1136/bmj.d7163 · Cited by 551
Lahti, M., Hätönen, H., & Välimäki, M. (2014) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.12.017 · Cited by 407
Salleh, N., Mendes, E., & Grundy, J. (2011) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.59 · Cited by 356
A Systematic Review of the Benefits of Hiring People with Disabilities
Lindsay, S., Cagliostro, E., Albarico, M., Mortaji, N., & Karon, L. (2018) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-018-9756-z · Cited by 361
O’Donovan, R., & McAuliffe, E. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4931-2 · Cited by 259
Effects of Therapy in Oropharyngeal Dysphagia by Speech and Language Therapists: A Systematic Review
Speyer, R., Baijens, L., Heijnen, M., & Zwijnenberg, I. (2010) · Dysphagia · doi:10.1007/s00455-009-9239-7 · Cited by 250
Moore, K. S. (2013) · Journal of Music Therapy · doi:10.1093/jmt/50.3.198 · Cited by 240
Bartesaghi Koc, C., Osmond, P., & Peters, A. (2017) · Urban Ecosystems · doi:10.1007/s11252-016-0578-5 · Cited by 244
Urban blue spaces and human health: A systematic review and meta-analysis of quantitative studies
Smith, N., Georgiou, M., King, A. C., Tieges, Z., Webb, S., & Chastin, S. (2021) · Cities · doi:10.1016/j.cities.2021.103413 · Cited by 212
Treatment of endometrial polyps: a systematic review
LIENG, M., ISTRE, O., & QVIGSTAD, E. (2010) · Acta Obstetricia et Gynecologica Scandinavica · doi:10.3109/00016349.2010.493196 · Cited by 208
DOMINGUES, A. R., PIRES, S. M., HALASA, T., & HALD, T. (2012) · Epidemiology and Infection · doi:10.1017/s0950268811002676 · Cited by 207
FRAX® with and without Bone Mineral Density
Kanis, J. A., McCloskey, E., Johansson, H., Oden, A., & Leslie, W. D. (2012) · Calcified Tissue International · doi:10.1007/s00223-011-9544-7 · Cited by 192
PROSPERO International prospective register of systematic reviews
Quayle, E., Cooper, K., Newman, E., & Cariola, L. A. (2017) · Cited by 186
Apathy Secondary to Stroke: A Systematic Review and Meta-Analysis
Caeiro, L., Ferro, J. M., & Costa, J. (2013) · Cerebrovascular Diseases · doi:10.1159/000346076 · Cited by 155
A checklist to assess the quality of survey studies in psychology
Protogerou, C., & Hagger, M. S. (2020) · Methods in Psychology · doi:10.1016/j.metip.2020.100031 · Cited by 146
Moore, M., & Barker, K. L. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0577-5 · Cited by 162
Virtual Reality and Computer Simulation in Social Work Education: A Systematic Review
Huttar, C. M., & BrintzenhofeSzoc, K. (2019) · Journal of Social Work Education · doi:10.1080/10437797.2019.1648221 · Cited by 153
Eichler, K., Wieser, S., Rüthemann, I., & Brügger, U. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-506 · Cited by 125
Refining the systematic literature review process—two participant-observer case studies
Kitchenham, B. A., Brereton, P., Turner, M., Niazi, M. K., Linkman, S., Pretorius, R., & Budgen, D. (2010) · Empirical Software Engineering · doi:10.1007/s10664-010-9134-8 · Cited by 112
Champaneria, R., Shah, L., Wilson, M., & DANIELS, J. P. (2016) · International Journal of Obstetric Anesthesia · doi:10.1016/j.ijoa.2016.07.009 · Cited by 114
Ubiquitous learning environments in higher education: A scoping literature review
Virtanen, M. A., Haavisto, E., Liikanen, E., & Kääriäinen, M. (2017) · Education and Information Technologies · doi:10.1007/s10639-017-9646-6 · Cited by 113
(2015) · PubMed Central · Cited by 108
Herselman, M., Esau, N., Kruger, J.-M., Labadarios, D., & Moosa, M. R. (2009) · Nutrition · doi:10.1016/j.nut.2009.07.009 · Cited by 114
Reporting systematic reviews: Some lessons from a tertiary study
Budgen, D., Brereton, P., Drummond, S., & Williams, N. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2017.10.017 · Cited by 99
A Green Infrastructure Typology Matrix to Support Urban Microclimate Studies
Bartesaghi-Koc, C., Osmond, P., & Peters, A. (2016) · Procedia Engineering · doi:10.1016/j.proeng.2016.10.022 · Cited by 114
Moody, A. N., Bull, J., Culpan, A.-M., Munyombwe, T., Sharma, N., Whitaker, M., & Wolstenhulme, S. (2017) · Clinical Radiology · doi:10.1016/j.crad.2017.06.121 · Cited by 100
A Review of Participant-Generated Image Methods in the Social Sciences
Balomenou, N., & Garrod, B. (2016) · Journal of Mixed Methods Research · doi:10.1177/1558689815581561 · Cited by 101
McKinney, C. H., & Honig, T. J. (2016) · Journal of Music Therapy · doi:10.1093/jmt/thw016 · Cited by 103
Analgesic effectiveness of transversus abdominis plane blocks after hysterectomy: a meta-analysis
Champaneria, R., Shah, L., Geoghegan, J., Gupta, J. K., & DANIELS, J. P. (2012) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2012.09.012 · Cited by 78
van Eikenhorst, L., Salema, N.-E., & Anderson, C. (2016) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2016.02.010 · Cited by 87
Skevington, S. M., Sovetkina, E., & Gillison, F. (2012) · AIDS and Behavior · doi:10.1007/s10461-012-0327-6 · Cited by 77
Renal disease and accidental falls: a review of published evidence
López‐Soto, P. J., Giorgi, A. D., Senno, E., Tiseo, R., Ferraresi, A., Canella, C., Rodríguez‐Borrego, M. A., Manfredini, R., & Fabbian, F. (2015) · BMC Nephrology · doi:10.1186/s12882-015-0173-7 · Cited by 81
Rice, L. A., Ousley, C., & Sosnoff, J. J. (2014) · Disability and Rehabilitation · doi:10.3109/09638288.2014.976718 · Cited by 67
Luijten, R. K. M. A. C., Fritsch-Stork, R. D. E., Bijlsma, J. W. J., & Derksen, R. H. W. M. (2012) · Autoimmunity Reviews · doi:10.1016/j.autrev.2012.12.001 · Cited by 79
The effectiveness of interventions addressing loneliness in older persons: An umbrella review
Jarvis, M.-A., Padmanabhanunni, A., Balakrishna, Y., & Chipps, J. (2020) · International Journal of Africa Nursing Sciences · doi:10.1016/j.ijans.2019.100177 · Cited by 68
Behavioural interventions to reduce sexual risk for HIV in heterosexual couples: a meta-analysis
LaCroix, J. M., Pellowski, J. A., Lennon, C. A., & Johnson, B. T. (2013) · Sexually Transmitted Infections · doi:10.1136/sextrans-2013-051135 · Cited by 71
Lean management approach in hospitals: a systematic review
Isfahani, H. M., Tourani, S., & Seyedin, H. (2018) · International Journal of Lean Six Sigma · doi:10.1108/ijlss-05-2017-0051 · Cited by 75
Vandrevala, T., Morrow, E. M., Coates, T., Boulton, R., Crawshaw, A. F., O'Dwyer, E. J., & Heitmeyer, C. (2024) · BMC Global and Public Health · doi:10.1186/s44263-024-00112-y · Cited by 77
Johnson, B. T., Low, R. E., & MacDonald, H. V. (2015) · Psychology & Health · doi:10.1080/08870446.2014.953533 · Cited by 58
Cui, Q., Li, D., Li, J., & Xue, J. (2020) · World Journal of Surgical Oncology · doi:10.1186/s12957-020-01890-z · Cited by 55
Psychological interventions with families of alcohol misusers: A systematic review
Templeton, L. J., Velleman, R. D. B., & Russell, C. C. (2010) · Addiction Research & Theory · doi:10.3109/16066350903499839 · Cited by 64
Ashraf, M. O., & Devadoss, V. (2013) · European Journal of Orthopaedic Surgery & Traumatology · doi:10.1007/s00590-012-1164-z · Cited by 77
Glanville, J., King, S., Guarner, F., Hill, C., & Sanders, M. E. (2015) · Nutrition Journal · doi:10.1186/s12937-015-0004-5 · Cited by 51
The educational value of mapping studies of software engineering literature
Kitchenham, B., Brereton, P., & Budgen, D. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806887 · Cited by 50
Relationship between knowledge sharing and job satisfaction: a systematic review
Rafique, G. M., & Mahmood, K. (2018) · Information and Learning Sciences · doi:10.1108/ils-03-2018-0019 · Cited by 53
Academic library leadership in the dawn of the new millennium: a systematic literature review
Ashiq, M., Rehman, S. U., Safdar, M., & Ali, H. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102355 · Cited by 48
Pandor, A., Kaltenthaler, E., Higgins, A., Lorimer, K., Smith, S. M., Wylie, K. R., & Wong, R. (2015) · BMC Public Health · doi:10.1186/s12889-015-1448-4 · Cited by 55
Walker, K. F., Stevenson, G., & Thornton, J. G. (2014) · JRSM Open · doi:10.1177/2042533313517688 · Cited by 45
Beuckels, E., & Wolf, R. P. D. (2024) · Information Communication & Society · doi:10.1080/1369118x.2024.2334913 · Cited by 54
Mubarak, N., Hatah, E., Khan, T. M., & Zin, C. S. (2019) · Journal of Asthma and Allergy · doi:10.2147/jaa.s202183 · Cited by 47
Herselman, M., Esau, N., Kruger, J.-M., Labadarios, D., & Moosa, M. R. (2010) · Journal of Renal Nutrition · doi:10.1053/j.jrn.2010.03.010 · Cited by 40
Lam, M. T., & McDiarmid, M. (2016) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.104.4.006 · Cited by 34
Smadi, H., Sargeant, J. M., Shannon, H. S., & Raina, P. S. (2012) · Journal of Epidemiology and Global Health · doi:10.1016/j.jegh.2012.12.001 · Cited by 33
Christie, L., Inman, J., Davys, D., & Cook, P. A. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.12.080 · Cited by 42
Lifestyle interventions to maternal weight loss after birth: a systematic review
Christiansen, P. K., Skjøth, M. M., Rothmann, M. J., Vinter, C. A., Lamont, R., & Draborg, E. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1186-2 · Cited by 34
Carlberg, E. B., & Löwing, K. (2013) · Developmental Medicine & Child Neurology · doi:10.1111/dmcn.12307 · Cited by 31
Eichler, K., Hess, S., Twerenbold, C., Sabatier, M., Meier, F., & Wieser, S. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210899 · Cited by 39
Larsen, M. H., Johannessen, G., & Heggdal, K. (2021) · Nursing Open · doi:10.1002/nop2.1110 · Cited by 32
López‐Soto, P. J., Manfredini, R., Smolensky, M. H., & Rodríguez‐Borrego, M. A. (2014) · Chronobiology International · doi:10.3109/07420528.2014.987295 · Cited by 28
Whitehouse, J. (2019) · European Journal of Trauma & Dissociation · doi:10.1016/j.ejtd.2019.03.002 · Cited by 34
The Systematic Review as a Research Process in Music Therapy
Hanson‐Abromeit, D., & Moore, K. S. (2014) · Journal of Music Therapy · doi:10.1093/jmt/thu002 · Cited by 37
Alreshidi, N. M., Livesley, J., Al‐Kalaldeh, M., & Long, T. (2020) · Comprehensive Child and Adolescent Nursing · doi:10.1080/24694193.2020.1824033 · Cited by 31
Childbirth care practices in public sector facilities in Jeddah, Saudi Arabia: A descriptive study
Altaweli, R. F., McCourt, C., & Baron, M. (2014) · Midwifery · doi:10.1016/j.midw.2014.03.006 · Cited by 26
Manual therapy and exercise for impingementrelated shoulder pain
Braun, C., & Hanchard, N. C. A. (2010) · Physical Therapy Reviews · doi:10.1179/174328810x12786297204675 · Cited by 26
Filming for auditing of real-life emergency teams: a systematic review
Brogaard, L., & Uldbjerg, N. (2019) · BMJ Open Quality · doi:10.1136/bmjoq-2018-000588 · Cited by 27
Assessing the Integrity of Clinical Trials Included in Evidence Syntheses
Núñez‐Núñez, M., Ibáñez, N. C., Zamora, J., Bueno‐Cavanillas, A., & Khan, K. S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20126138 · Cited by 26
Self-citationGhojazadeh, M., Aghdash, S. A., Azar, F. P., Fardid, M., Mohseni, M., & Tahamtani, T. (2015) · Journal of Analytical Research in Clinical Medicine · doi:10.15171/jarcm.2015.001 · Cited by 24
Almedghio, S., Almari, F., Chakrabarti, I., & Arshad, M. S. (2017) · Journal of Wrist Surgery · doi:10.1055/s-0037-1607214 · Cited by 25
Aghdash, S. A., Sadeghi-Bazarghani, H., Heydari, M., Rezapour, R., & Derakhshani, N. (2018) · Bulletin of Emergency and Trauma · doi:10.29252/beat-060202 · Cited by 23
Systematic reviews to evaluate causation: an overview of methods and application
Khan, K. S., Ball, E., Fox, C. E., & Meads, C. (2012) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2011-100287 · Cited by 27
Self-citationFertility-Sparing Surgery in Ovarian Cancer: A Systematic Review
du Bois, A., Heitz, F., & Harter, P. (2013) · Oncology Research and Treatment · doi:10.1159/000353598 · Cited by 26
Peinemann, F., & Kleijnen, J. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-007540 · Cited by 22
Treatment of Endometrial Polyps – A Systematic Review
Lieng, M., Istre, O., & Qvigstad, E. (2010) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2010.08.098 · Cited by 21
Khan, K. S., Fawzy, M., & Chien, P. F. W. (2023) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.14837 · Cited by 20
Self-citationA Study of Computing Undergraduates Undertaking a Systematic Literature Review
Pearl Brereton, A. (2010) · IEEE Transactions on Education · doi:10.1109/te.2010.2090662 · Cited by 19
Regmi, K., & Lwin, C. M. (2020) · medRxiv · doi:10.1101/2020.06.13.20130294 · Cited by 20
Nazar, Z. J., Nazar, H., White, S. J., & Rutter, P. M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0213607 · Cited by 18
Yammine, K., & Harvey, A. (2013) · The Bone & Joint Journal · doi:10.1302/0301-620x.95b4.30893 · Cited by 18
Lin, E. S., Flanagan, S. K., Varga, S. M., Zaff, J. F., & Margolius, M. (2019) · American Journal of Community Psychology · doi:10.1002/ajcp.12398 · Cited by 26
On the gaining of understanding; syntheses, themes and information analysis
Bawden, D. (2012) · Library and Information Research · doi:10.29173/lirg483 · Cited by 24
Cabeza‐Ramírez, L. J., Cañizares, S. M. S., & García, F. J. F. (2017) · Journal of Global Economy · doi:10.18089/tms.2017.13307 · Cited by 20
Diagnosis of cervical spine injuries in children: a systematic review
Schöneberg, C., Schweiger, B., Hussmann, B., Kauther, M. D., Lendemans, S., & Waydhas, C. (2013) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-013-0295-1 · Cited by 18
Cost-effectiveness of PET and PET/Computed Tomography
Gerke, O., Hermansson, R., Hess, S., Schifter, S., Vach, W., & Høilund‐Carlsen, P. F. (2014) · PET Clinics · doi:10.1016/j.cpet.2014.09.008 · Cited by 19
Information Technology Artifacts in the Regulatory Compliance of Business Processes: A Meta-Analysis
Akhigbe, O., Amyot, D., & Richards, G. (2015) · Lecture notes in business information processing · doi:10.1007/978-3-319-17957-5_6 · Cited by 17
Recent Trends in Software Testing Education: A Systematic Literature Review
Lauvås, P., & Arcuri, A. (2018) · Open Repository and Bibliography (University of Luxembourg) · Cited by 17
Overview of systematic reviews on invasive treatment of stable coronary artery disease
Kuukasjärvi, P., Malmivaara, A. O. V., Halinen, M., Hartikainen, J. E. K., Keto, P. E., Talvensaari, T., Tierala, I., & Mākelä, M. (2006) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646230605104x · Cited by 17
Haber, M., Drake, A., & Nightingale, J. M. (2020) · Radiography · doi:10.1016/j.radi.2020.01.002 · Cited by 17
The Gender Gap in Partnered Orgasm: A Scoping Review of Evidence with Graphical Comparisons
McElroy, E. E., & Perry, S. L. (2024) · The Journal of Sex Research · doi:10.1080/00224499.2024.2390672 · Cited by 19
Methodological challenges when performing a systematic review
Anderson, N. K., & Jayaratne, Y. S. N. (2015) · European Journal of Orthodontics · doi:10.1093/ejo/cjv022 · Cited by 16
Doustmohammadian, A., & Bazhan, M. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01625-5 · Cited by 25
A Systematic Classification and Analysis of NFRs
Loucopoulos, P., Sun, J., Zhao, L., & Heidari, F. (2013) · TU/e Research Portal · Cited by 18
Andrew, L., Maslin‐Prothero, S., Costello, L. N., Dare, J., & Robinson, K. (2015) · Nurse Education Today · doi:10.1016/j.nedt.2015.04.018 · Cited by 21
Tomei, G., Pieroni, M. F., & Tomba, E. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23828 · Cited by 16
Quality of diabetes care in cancer: a systematic review
Griffiths, R. I., Keating, N. L., & Bankhead, C. R. (2018) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzy124 · Cited by 14
Metadata
- Authors
- Khan, K. S., & Zamora, J.
- Venue
- CRC Press eBooks
- Publisher
- CRC Press
- Published
- 2022-11-28
- OpenAlex
- W1587873557
- Cited by
- 151
- References
- 0
- Citations by year
- 2025: 3 · 2024: 5 · 2023: 3 · 2022: 2
- FWCI
- 2.53
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- CRC Press eBooks (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- systematic reviews, evidence-based medicine, clinical guidelines, clinical librarians
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.