The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Systematic reviews of clinical practice guidelines: a methodological guide
Open accessAbstract
OBJECTIVES: Systematic reviews (SRs) of clinical practice guidelines (CPGs) are unique knowledge syntheses that require tailored approaches to, and greater subjectivity in, design and execution compared with other SRs in clinical epidemiology. We provide review authors structured direction on how to design and conduct methodologically rigorous SRs of CPGs. STUDY DESIGN AND SETTING: A guidance paper outlining suggested methodology for conducting all stages of an SR of CPGs. We present concrete examples of approaches used by published reviews, including a case exemplar demonstrating how this methodology was applied to our own SR of CPGs. RESULTS: Review context and the unique characteristics of CPGs as research syntheses or clinical guidance statements must be considered in all aspects of review design and conduct. Researchers should develop a "PICAR" statement to help form and focus on the research question(s) and eligibility criteria, assess CPG quality using a validated appraisal tool, and extract, analyze, and summarize data in a way that is cogent and transparent. CONCLUSION: SRs of CPGs can be used to systematically identify, assess, and summarize the current state of guidance on a clinical topic. These types of reviews often require methodological tailoring to ensure that their objectives and timelines are effectively and efficiently addressed; however, they should all meet the criteria for an SR, follow a rigorous methodological approach, and adhere to transparent reporting practices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
AGREE II: advancing guideline development, reporting and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090449 · Cited by 3,790
What is ‘quality of evidence’ and why is it important to clinicians?
Guyatt, G. H., Oxman, A. D., Kunz, R., Vist, G. E., Falck-Ytter, Y., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39490.551019.be · Cited by 3,250
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Clinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
Methley, A. M., Campbell, S., Chew-Graham, C., McNally, R., & Cheraghi-Sohi, S. (2014) · BMC Health Services Research · doi:10.1186/s12913-014-0579-0 · Cited by 2,706
Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000055 · Cited by 2,587
Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines
Woolf, S. H., Grol, R., Hutchinson, A., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7182.527 · Cited by 2,548
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
Five steps to conducting a systematic review
Khan, K. S., Kunz, R., Kleijnen, J., & Antes, G. (2003) · Journal of the Royal Society of Medicine · doi:10.1177/014107680309600304 · Cited by 1,873
VTE, Thrombophilia, Antithrombotic Therapy, and Pregnancy
Bates, S. M., Greer, I. A., Middeldorp, S., Veenstra, D. L., Prabulos, A.-M., & Vandvik, P. O. (2012) · Chest · doi:10.1378/chest.11-2300 · Cited by 1,525 · cited 1×
“(2012) [57] High quality ‘‘For breastfeeding women, w suggest alternative anticoagulants rather than fondaparinux (Grade 2C).”
Background(2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.18 · Cited by 1,446
An Introduction to Systematic Reviews
Gough, D., Oliver, S., & Thomas, J. (2017) · doi:10.4135/9781036234942 · Cited by 1,239
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232
A scoping review of rapid review methods
Tricco, A. C., Antony, J., Zarin, W., Strifler, L., Ghassemi, M., Ivory, J., Perrier, L., Hutton, B., Moher, D., & Straus, S. E. (2015) · BMC Medicine · doi:10.1186/s12916-015-0465-6 · Cited by 1,146
Guidelines for Clinical Practice: From Development to Use
(1992) · National Academies Press eBooks · doi:10.17226/1863 · Cited by 915
The AGREE Reporting Checklist: a tool to improve reporting of clinical practice guidelines
Brouwers, M. C., Kerkvliet, K., Spithoff, K., & AGREE Next Steps Consortium (2016) · BMJ · doi:10.1136/bmj.i1152 · Cited by 785
Guidelines for reporting meta-epidemiological methodology research
Murad, M. H., & Wang, Z. (2017) · Evidence Based Medicine · doi:10.1136/ebmed-2017-110713 · Cited by 515 · cited 1×
“Although no checklist of reporting items was designed specifically for SRs of CPGs, we recommend authors make use of existing checklists, such as the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist [69] or guidelines for reporting meta-epidemiological research [70], which will be…”
MethodEvidence-Based Practice Across the Health Professions
Hoffmann, T., Bennett, S. H., & Mar, C. D. (2009) · e-publications@bond (Bond University) · Cited by 294
Practice Bulletin No. 123: Thromboembolism in Pregnancy
(2011) · Obstetrics & Gynecology · doi:10.1097/aog.0b013e3182310c4c · Cited by 291
Appraisal Tools for Clinical Practice Guidelines: A Systematic Review
Siering, U., Eikermann, M., Hausner, E., Hoffmann-Eßer, W., & Neugebauer, E. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082915 · Cited by 233
Nicolaides, A., Fareed, J., Kakkar, A. K., Comerota, A. J., Goldhaber, S. Z., Hull, R., Myers, K., Samama, M., Fletcher, J., Kalodiki, E., et al. (2013) · Clinical and Applied Thrombosis/Hemostasis · doi:10.1177/1076029612474840 · Cited by 185
Evaluation and adaptation of clinical practice guidelines
Graham, I. D., & Harrison, M. B. (2005) · Evidence-Based Nursing · doi:10.1136/ebn.8.3.68 · Cited by 177 · cited 1×
“Characteristics such as these can be collected through the construction of a recommendation matrix, that is, a table that specifies all elements by which recommendations will be characterized and summarized [55,56].”
BackgroundHoffmann-Eßer, W., Siering, U., Neugebauer, E. A. M., Brockhaus, A. C., Lampert, U., & Eikermann, M. (2017) · PLoS ONE · doi:10.1371/journal.pone.0174831 · Cited by 171
A Guide to Qualitative Meta-Synthesis
Finfgeld-Connett, D. (2018) · Routledge eBooks · doi:10.4324/9781351212793 · Cited by 166
Jolliffe, L. J., Lannin, N. A., Cadilhac, D. A.-M., & Hoffmann, T. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018791 · Cited by 159
Guidelines on treatment of perinatal depression with antidepressants: An international review
Molenaar, N. M., Kamperman, A. M., Boyce, P., & Bergink, V. (2018) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867418762057 · Cited by 156
Meta‐synthesis and evidence‐based health care – a method for systematic review
Korhonen, A., Hakulinen, T., Jylhä, V., & Holopainen, A. (2012) · Scandinavian Journal of Caring Sciences · doi:10.1111/scs.12003 · Cited by 153
Schünemann, H. J., Fretheim, A., & Oxman, A. D. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-21 · Cited by 153
Clinical Consensus Statement Development Manual
Rosenfeld, R. M., Nnacheta, L. C., & Corrigan, M. D. (2015) · Otolaryngology · doi:10.1177/0194599815601394 · Cited by 152
Meta-synthesis of qualitative research: the challenges and opportunities
Mohammed, M. A., Moles, R. J., & Chen, T. F. (2016) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-016-0289-2 · Cited by 146
MacQUEEN, G. M., Santaguida, P. L., Keshavarz, H., Jaworska, N., Levine, M., Beyene, J., & Raina, P. S. (2016) · The Canadian Journal of Psychiatry · doi:10.1177/0706743716664885 · Cited by 143
The Scientific Basis of Guideline Recommendations on Sugar Intake: A Systematic Review
Erickson, J. M., Sadeghirad, B., Lytvyn, L., Slavin, J. L., & Johnston, B. C. (2016) · Annals of Internal Medicine · doi:10.7326/m16-2020 · Cited by 133
Hoffmann-Eßer, W., Siering, U., Neugebauer, E. A. M., Lampert, U., & Eikermann, M. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.12.009 · Cited by 133
Watine, J., Friedberg, B., Nagy, E., Ónody, R., Oosterhuis, W. P., Bunting, P. S., Charet, J.-C., & Horvath, A. R. (2006) · Clinical Chemistry · doi:10.1373/clinchem.2005.056952 · Cited by 120
How to Write an Effective Discussion
HESS, D. R. (2023) · Respiratory Care · doi:10.4187/respcare.11435 · Cited by 118
Chiappini, E., Bortone, B., Galli, L., & de Martino, M. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015404 · Cited by 117
A Critical Review of the Quality of Cough Clinical Practice Guidelines
Jiang, M., Guan, W., Fang, Z., Xie, Y., Xie, J., Chen, H., Wei, D., Lai, K., & Zhong, N. (2016) · CHEST Journal · doi:10.1016/j.chest.2016.04.028 · Cited by 65
Yao, L., Chen, Y., Wang, X., Shi, X., Wang, Y., Guo, T., & Yang, K. (2017) · International Journal of Clinical Practice · doi:10.1111/ijcp.12931 · Cited by 62
Quality of clinical practice guidelines in delirium: a systematic appraisal
Bush, S. H., Marchington, K. L., Agar, M., Davis, D. H. J., Sikora, L., & Tsang, T. W. Y. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013809 · Cited by 59
DEFINING RAPID REVIEWS: A MODIFIED DELPHI CONSENSUS APPROACH
Kelly, S., Moher, D., & Clifford, T. (2016) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462316000489 · Cited by 59
Self-citationJohnston, A., Hsieh, S., Carrier, M., Kelly, S., Bai, Z., Skidmore, B., & Wells, G. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207410 · Cited by 43
Self-citationJakes, A. D., Marec‐Bérard, P., Phillips, R. S., & Stark, D. (2014) · Journal of Adolescent and Young Adult Oncology · doi:10.1089/jayao.2014.0032 · Cited by 40
A critical review of recent clinical practice guidelines on management of cryptorchidism
Kim, J. K., Chua, M. E., Ming, J. M., Santos, J. D., Zani‐Ruttenstock, E., Marson, A., Bayley, M. T., & Koyle, M. A. (2017) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2017.11.050 · Cited by 40
Acuña, S. A., Lam, W., Daly, C., Kim, S., & Baxter, N. N. (2017) · Transplantation Reviews · doi:10.1016/j.trre.2017.10.002 · Cited by 39
Crosby, E. T. (2012) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-012-9855-9 · Cited by 33
Knight, S., Takagi, M., Fisher, E., Anderson, V. A., Lannin, N. A., Tavender, E. J., & Scheinberg, A. M. (2018) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2018.05.031 · Cited by 33
Bosch, M., Tavender, E. J., Bragge, P., Gruen, R. L., & Green, S. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2012.01835.x · Cited by 32
Antipsychotic augmentation for major depressive disorder: A review of clinical practice guidelines
Simons, P., Cosgrove, L., Shaughnessy, A. F., & Bursztajn, H. J. (2017) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2017.10.003 · Cited by 22
Systematic review of clinical practice guidelines in kidney transplantation
O’Donoghue, K., Reed, R. D., Knight, S. R., et al. (2017) · BJS Open · doi:10.1002/bjs5.17 · Cited by 11
(2012) · Sage eBooks · doi:10.4135/9781483384436.n10 · Cited by 7
Rapid Reviews: Sisyphos‘ Erlösung? – Eine Bestandsaufnahme
Mattivi, J. T., & Buchberger, B. (2015) · Das Gesundheitswesen · doi:10.1055/s-0035-1548857 · Cited by 4
Cited by
Dagens, A., Sigfrid, L., Cai, E., Lipworth, S., Cheng, V., Harris, E., Bannister, P., Rigby, I., & Horby, P. (2020) · BMJ · doi:10.1136/bmj.m1936 · Cited by 156
Sørensen, A., Juhl Jørgensen, K., & Munkholm, K. (2022) · Therapeutic Advances in Psychopharmacology · doi:10.1177/20451253211067656 · Cited by 52
Gabriel, F. C., Stein, A. T., de Melo, D. O., Henrique Fontes-Mota, G. C., dos Santos, I. B., de Oliveira, A. F., Fráguas, R., & Ribeiro, E. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-051918 · Cited by 15
Metadata
- Authors
- Johnston, A., Kelly, S. E., Hsieh, S.-C., Skidmore, B., & Wells, G. A.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 108
- Pages
- 64-76
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2902426622
- Cited by
- 273
- References
- 56
- FWCI
- 3.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.