Meeting the review family: exploring review types and associated information retrieval requirements
Open accessAbstract
BACKGROUND AND OBJECTIVES: The last decade has witnessed increased recognition of the value of literature reviews for advancing understanding and decision making. This has been accompanied by an expansion in the range of methodological approaches and types of review. However, there remains uncertainty over definitions and search requirements beyond those for the 'traditional' systematic review. This study aims to characterise health related reviews by type and to provide recommendations on appropriate methods of information retrieval based on the available guidance. METHODS: A list of review types was generated from published typologies and categorised into 'families' based on their common features. Guidance on information retrieval for each review type was identified by searching pubmed, medline and Google Scholar, supplemented by scrutinising websites of review producing organisations. RESULTS: Forty-eight review types were identified and categorised into seven families. Published guidance reveals increasing specification of methods for information retrieval; however, much of it remains generic with many review types lacking explicit requirements for the identification of evidence. CONCLUSIONS: Defining review types and utilising appropriate search methods remain challenging. By familiarising themselves with a range of review methodologies and associated search methods, information specialists will be better equipped to select suitable approaches for future projects.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Scoping reviews are similar to but distinct from other well-known forms of evidence synthesis.
“Scoping reviews are similar to but distinct from other well-known forms of evidence synthesis of which there are many [16].”
From Scoping reviews: reinforcing and advancing the methodology and application (2021) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · see citing works
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859 · see citing works
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828 · see citing works
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817 · see citing works
Self-citationThe integrative review: updated methodology
Whittemore, R., & Knafl, K. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03621.x · Cited by 10,241 · see citing works
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312 · see citing works
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · see citing works
Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ
Tong, A., Flemming, K., McInnes, E., Oliver, S., & Craig, J. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-181 · Cited by 3,569 · see citing works
Lockwood, C., Munn, Z., & Porritt, K. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000062 · Cited by 2,456 · see citing works
Purposeful Sampling in Qualitative Research Synthesis
Suri, H. (2011) · Qualitative Research Journal · doi:10.3316/qrj1102063 · Cited by 2,284 · see citing works
A scoping review on the conduct and reporting of scoping reviews
Tricco, A. C., Lillie, E., Zarin, W., O’Brien, K., Colquhoun, H., Kastner, M., Levac, D., Ng, C., Sharpe, J. P., Wilson, K., et al. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0116-4 · Cited by 2,250 · see citing works
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132 · see citing works
Self-citationMethods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,087 · see citing works
Dixon-Woods, M., Cavers, D., Agarwal, S., Annandale, E., Arthur, A., Harvey, J., Hsu, R., Katbamna, S., Olsen, R., Smith, L., et al. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-35 · Cited by 2,053 · see citing works
Self-citationSynthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987 · see citing works
The design of browsing and berrypicking techniques for the online search interface
Bates, M. J. (1989) · Online Review · doi:10.1108/eb024320 · Cited by 1,768 · see citing works
RAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-21 · Cited by 1,374 · see citing works
Conducting content‐analysis based literature reviews in supply chain management
Seuring, S. A., & Gold, S. (2012) · Supply Chain Management An International Journal · doi:10.1108/13598541211258609 · Cited by 1,276 · see citing works
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · see citing works
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227 · see citing works
The Agency for Healthcare Research and Quality
Baine, W. B. (2006) · Italian Journal of Public Health · doi:10.2427/5924 · Cited by 1,191 · see citing works
Systematic Approaches to a Successful Literature Review
Booth, A., Sutton, A., Clowes, M., & James, M. M.-S. (2022) · SAGE Publications Ltd eBooks · doi:10.4135/9781036232009 · Cited by 1,174 · see citing works
Self-citationMunn, Z., Stern, C., Aromataris, E., Lockwood, C., & Jordan, Z. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0468-4 · Cited by 1,164 · see citing works
A scoping review of rapid review methods
Tricco, A. C., Antony, J., Zarin, W., Strifler, L., Ghassemi, M., Ivory, J., Perrier, L., Hutton, B., Moher, D., & Straus, S. E. (2015) · BMC Medicine · doi:10.1186/s12916-015-0465-6 · Cited by 1,146 · see citing works
Finding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 943 · see citing works
Systematic Approaches to a Successful Literature Review
MacDonald, J. (2013) · Journal of the Canadian Health Libraries Association / Journal de l Association de bilbiothèques de la santé du Canada · doi:10.5596/c13-009 · Cited by 887 · see citing works
The Medical Review Article: State of the Science
MULROW, C. D. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-106-3-485 · Cited by 856 · see citing works
Terwee, C. B., Jansma, E. P., Riphagen, I. I., & de Vet, H. C. W. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9528-5 · Cited by 849 · see citing works
Higgins, J. (2011) · Medical Entomology and Zoology · Cited by 815 · see citing works
Writing a narrative biomedical review: considerations for authors, peer reviewers, and editors
Gasparyan, A. Y., Ayvazyan, L., Blackmore, H. L., & Kitas, G. D. (2011) · Rheumatology International · doi:10.1007/s00296-011-1999-3 · Cited by 801 · see citing works
Hoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R. F., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Díaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 771 · see citing works
A methodology for systematic mapping in environmental sciences
James, K. L., Randall, N. P., & Haddaway, N. R. (2016) · Environmental Evidence · doi:10.1186/s13750-016-0059-6 · Cited by 769 · see citing works
Expediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752 · see citing works
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681 · see citing works
Meta-Study of Qualitative Health Research
Paterson, B., Thorne, S., Canam, C., & Jillings, C. (2001) · doi:10.4135/9781412985017 · Cited by 664 · see citing works
“Best fit” framework synthesis: refining the method
Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-37 · Cited by 649 · see citing works
Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research
Campbell, R., Pound, P., Morgan, M., Daker-White, G., Britten, N., Pill, R., Yardley, L., Pope, C., & Donovan, J. (2011) · Health Technology Assessment · doi:10.3310/hta15430 · Cited by 619 · see citing works
RAMESES publication standards: meta-narrative reviews
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-20 · Cited by 610 · see citing works
Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001603 · Cited by 596 · see citing works
Booth, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0249-x · Cited by 587 · see citing works
Self-citationNoyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497 · see citing works
Self-citationSystematic review automation technologies
Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-74 · Cited by 472 · see citing works
Chapter 2: Systematic Reviews of Qualitative Evidence
Lockwood, C. S., Porritt, K. A., Munn, Z., Rittenmeyer, L., Salmond, S. W., Bjerrum, M. B., Loveday, H. P., Carrier, J., & Stannard, D. (2019) · JBI eBooks · doi:10.46658/jbirm-17-02 · Cited by 395 · see citing works
Searching for studies: a guide to information retrieval for Campbell systematic reviews
Kugley, S., Wade, A., Thomas, J., Mahood, Q., Jørgensen, A. K., Hammerstrøm, K., & Sathe, N. (2017) · Campbell Systematic Reviews · doi:10.4073/cmg.2016.1 · Cited by 371 · see citing works
Methods for knowledge synthesis: An overview
Whittemore, R., Chao, A. M., Jang, M., Minges, K. E., & Park, C. (2014) · Heart & Lung · doi:10.1016/j.hrtlng.2014.05.014 · Cited by 360 · see citing works
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0031-5 · Cited by 351 · see citing works
Geersing, G.-J., Bouwmeester, W., Zuithoff, P., Spijker, R., Leeflang, M., & Moons, K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032844 · Cited by 350 · see citing works
Kastner, M., Tricco, A. C., Soobiah, C., Lillie, E., Perrier, L., Horsley, T., Welch, V., Cogo, E., Antony, J., & Straus, S. E. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-114 · Cited by 345 · see citing works
Hannes, K., & Macaitis, K. (2012) · Qualitative Research · doi:10.1177/1468794111432992 · Cited by 320 · see citing works
Arnold, R., & Fletcher, D. (2012) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.34.3.397 · Cited by 318 · see citing works
Cochrane diagnostic test accuracy reviews
Leeflang, M., Deeks, J. J., Takwoingi, Y., & Macaskill, P. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-82 · Cited by 298 · see citing works
(2010) · Choice Reviews Online · doi:10.5860/choice.48-0943 · Cited by 290 · see citing works
All in the Family: systematic reviews, rapid reviews, scoping reviews, realist reviews, and more
Moher, D., Stewart, L., & Shekelle, P. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0163-7 · Cited by 288 · see citing works
Chapter 2: Systematic reviews of qualitative evidence
(2020) · JBI eBooks · doi:10.46658/jbimes-20-03 · Cited by 286 · see citing works
A time-responsive tool for informing policy making: rapid realist review
Saul, J. E., Willis, C. D., Bitz, J., & Best, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-103 · Cited by 278 · see citing works
Booth, A., Harris, J., Croot, E. J., Springett, J., Campbell, F., & Wilkins, E. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-118 · Cited by 278 · see citing works
Self-citationIntroduction to Systematic Reviews
Clarke, M. J. (2017) · Veterinary Evidence · doi:10.18849/ve.v2i2.131 · Cited by 276 · see citing works
The Challenges of Searching for and Retrieving Qualitative Studies
Barroso, J., Gollop, C. J., Sandelowski, M., Meynell, J., Pearce, P. F., & Collins, L. J. (2003) · Western Journal of Nursing Research · doi:10.1177/0193945902250034 · Cited by 272 · see citing works
"Brimful of STARLITE": toward standards for reporting literature searches.
Booth, A. (2006) · Europe PMC (PubMed Central) · Cited by 267 · see citing works
Self-citationInnovations in the systematic review of text and opinion
McArthur, A., Klugárová, J., Yan, H., & Florescu, S. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000060 · Cited by 254 · see citing works
"Meta Interpretation": A Method for the Interpretive Synthesis of Qualitative Research
Weed, M. (2008) · Forum qualitative Sozialforschung · doi:10.17169/fqs-6.1.508 · Cited by 202 · see citing works
Kable, A. K., Pich, J., & Maslin‐Prothero, S. (2012) · Nurse Education Today · doi:10.1016/j.nedt.2012.02.022 · Cited by 202 · see citing works
The art and science of knowledge synthesis
Tricco, A. C., Tetzlaff, J., & Moher, D. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.007 · Cited by 200 · see citing works
Systematic searching for theory to inform systematic reviews: is it feasible? Is it desirable?
Booth, A., & Carroll, C. (2015) · Health Information & Libraries Journal · doi:10.1111/hir.12108 · Cited by 196 · see citing works
Self-citationImproving the peer review of narrative literature reviews
Byrne, J. A. (2016) · Research Integrity and Peer Review · doi:10.1186/s41073-016-0019-2 · Cited by 194 · see citing works
A methodological systematic review of what’s wrong with meta-ethnography reporting
France, E. F., Ring, N., Thomas, R., Noyes, J., Maxwell, M., & Jepson, R. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-119 · Cited by 183 · see citing works
Shemilt, I., Simon, A., Hollands, G. J., Marteau, T. M., Ogilvie, D., O'Mara‐Eves, A., Kelly, M. P., & Thomas, J. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1093 · Cited by 170 · see citing works
Harris, J. L., Booth, A., Cargo, M., Hannes, K., Harden, A., Flemming, K., Garside, R., Pantoja, T., Thomas, J., & Noyes, J. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.023 · Cited by 165 · see citing works
Self-citationKoffel, J. B. (2015) · PLOS ONE · doi:10.1371/journal.pone.0125931 · Cited by 159 · see citing works
Tricco, A. C., Soobiah, C., Antony, J., Cogo, E., MacDonald, H., Lillie, E., Tran, J., D'Souza, J., Hui, W., Perrier, L., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.030 · Cited by 159 · see citing works
Roles for librarians in systematic reviews: a scoping review
Spencer, A. J., & Eldredge, J. D. (2018) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2018.82 · Cited by 157 · see citing works
European network for health technology assessment – EUnetHTA
Chamova, J., & Lange, J. (2013) · Medical Writing · doi:10.1179/2047480613z.000000000138 · Cited by 151 · see citing works
Booth, A. (2016) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.13140/rg.2.1.2318.0562 · Cited by 151 · see citing works
Self-citationSynthesizing Qualitative Research: Choosing the Right Approach
Hannes, K., & Lockwood, C. S. (2011) · Cited by 144 · see citing works
Understanding heart failure; explaining telehealth—a hermeneutic systematic review
Greenhalgh, T., A’Court, C., & Shaw, S. (2017) · BMC Cardiovascular Disorders · doi:10.1186/s12872-017-0594-2 · Cited by 141 · see citing works
Cooper, C., Booth, A., Britten, N., & Garside, R. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0625-1 · Cited by 137 · see citing works
Self-citationSelecting and implementing overview methods: implications from five exemplar overviews
Pollock, A., Campbell, P., Brunton, G., Hunt, H., & Estcourt, L. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0534-3 · Cited by 134 · see citing works
Stansfield, C., Dickson, K., & Bangpan, M. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0371-9 · Cited by 122 · see citing works
Tricco, A. C., Zarin, W., Ghassemi, M., Nincic, V., Lillie, E., Page, M. J., Shamseer, L., Antony, J., Rios, P., Hwee, J., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.014 · Cited by 122 · see citing works
The librarian's roles in the systematic review process: a case study.
Harris, M. R. (2005) · Europe PMC (PubMed Central) · Cited by 111 · see citing works
Support needs of patients with COPD: a systematic literature search and narrative review
Gardener, C., Ewing, G., Kuhn, I. L., et al. (2018) · International Journal of COPD · doi:10.2147/copd.s155622 · Cited by 107 · see citing works
Kastner, M., Antony, J., Soobiah, C., Straus, S. E., & Tricco, A. C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.11.022 · Cited by 103 · see citing works
How much searching is enough? Comprehensive versus optimal retrieval for technology assessments
Booth, A. (2010) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462310000966 · Cited by 88 · see citing works
Self-citationSynthesizing Qualitative Research
(2011) · Wiley eBooks · doi:10.1002/9781119959847 · Cited by 80 · see citing works
Mack, I., Penders, J., Cook, J., Dugmore, J., Mazurak, N., & Enck, P. (2018) · Current Neuropharmacology · doi:10.2174/1570159x16666180118101354 · Cited by 79 · see citing works
Tricco, A. C., Antony, J., Soobiah, C., Kastner, M., Cogo, E., MacDonald, H. R., D'Souza, J., Hui, W., & Straus, S. E. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.11.021 · Cited by 76 · see citing works
Cook, C. N., Nichols, S. J., Webb, J. A., Fuller, R. A., & Richards, R. M. (2017) · Biological Conservation · doi:10.1016/j.biocon.2017.07.004 · Cited by 67 · see citing works
Cooper, C., Lovell, R., Husk, K., Booth, A., & Garside, R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1286 · Cited by 66 · see citing works
Self-citationAveyard, H., & Bradbury‐Jones, C. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0751-7 · Cited by 60 · see citing works
Briscoe, S. (2015) · BMC Research Notes · doi:10.1186/s13104-015-1079-y · Cited by 57 · see citing works
AHRQ Series Paper 1: Comparing medical interventions: AHRQ and the Effective Health-Care Program
Slutsky, J. R., Atkins, D. C., Chang, S., & Sharp, B. A. C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.06.009 · Cited by 49 · see citing works
Denison, H. J., Dodds, R. M., Ntani, G., Cooper, R., Cooper, C. C., Sayer, A. A., & Baird, J. (2013) · Archives of Public Health · doi:10.1186/0778-7367-71-21 · Cited by 49 · see citing works
Voils, C. I., Hassselblad, V., Crandell, J., Chang, Y., Lee, E., & Sandelowski, M. (2009) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2009.008186 · Cited by 47 · see citing works
Realist Review: Current Practice and Future Prospects
Berg, R. C., & Nanavati, J. (2016) · NORA - Norwegian Open Research Archives · Cited by 47 · see citing works
Mixed Methods Synthesis: A Worked Example
Kavanagh, J., Campbell, F., Harden, A., & Thomas, J. (2011) · Wiley eBooks · doi:10.1002/9781119959847.ch6 · Cited by 36 · see citing works
How Far Do You Go? Efficient Searching for Indirect Evidence
Hawkins, N., Scott, D. A., & Woods, B. S. (2009) · Medical Decision Making · doi:10.1177/0272989x08330120 · Cited by 35 · see citing works
Evidence-based information needs of public health workers: a systematized review
Barr‐Walker, J. (2017) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2017.109 · Cited by 35 · see citing works
Perryman, C. (2016) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.104.1.014 · Cited by 35 · see citing works
Preston, L., Carroll, C., Gardois, P., Paisley, S., & Kaltenthaler, E. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0074-7 · Cited by 32 · see citing works
Self-citationNiederstadt, C., & Droste, S. (2010) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462310001066 · Cited by 30 · see citing works
A review of the reporting of web searching to identify studies for C ochrane systematic reviews
Briscoe, S. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1275 · Cited by 27 · see citing works
Rapid Evidence Assessment Toolkit
Thomas, J., Newman, M. J., & Gough, D. (2008) · Cited by 21 · see citing works
Utilisation of search filters in systematic reviews of prognosis questions
Chatterley, T., & Dennett, L. (2012) · Health Information & Libraries Journal · doi:10.1111/hir.12004 · Cited by 21 · see citing works
Performance of a mixed filter to identify relevant studies for mixed studies reviews
Sherif, R. E., Pluye, P., Gore, G. C., Granikov, V., & Hong, Q. N. (2016) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.104.1.007 · Cited by 21 · see citing works
#CochraneTech: Technology and the Future of Systematic Reviews
Elliott, J., Sim, I., Thomas, J. A., Owens, N., Dooley, G., Riis, J., Wallace, B., Thomas, J., Noel-Storr, A. H., Gabriel Rada, G., et al. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.ed000091 · Cited by 21 · see citing works
Otter, M. E., Wright, J. M., & King, N. V. (2017) · New Review of Academic Librarianship · doi:10.1080/13614533.2017.1330219 · Cited by 19 · see citing works
Choosing and using methodological search filters: searchers' views
Beale, S., Duffy, S., Glanville, J., Lefebvre, C., Wright, D., McCool, R., Varley, D., Boachie, C., Fraser, C. M., Harbour, J., et al. (2014) · Health Information & Libraries Journal · doi:10.1111/hir.12062 · Cited by 16 · see citing works
Bayesian Approaches to the Synthesis of Qualitative and Quantitative Research Findings
Crandell, J., Voils, C. I., & Sandelowski, M. (2011) · doi:10.1002/9781119959847.ch7 · Cited by 12 · see citing works
EVIDENT Guidance for Reviewing the Evidence: a compendium of methodological literature and websites
Booth, A. (2016) · doi:10.13140/rg.2.1.1562.9842 · Cited by 12 · see citing works
Self-citationDequen, P., Sutton, A. J., Scott, D. A., & Abrams, K. R. (2014) · Value in Health · doi:10.1016/j.jval.2014.02.013 · Cited by 11 · see citing works
Self-citationFinding Evidence for Comparing Medical Interventions
Relevo, R., & Balshem, H. (2011) · Europe PMC (PubMed Central) · Cited by 9 · see citing works
Oliver, S. R. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076815575231 · Cited by 8 · see citing works
(Re)search Filter Bubble Effect—An Issue Still Unfairly Neglected
Ćurković, M., & Košec, A. (2019) · Advances in Nutrition · doi:10.1093/advances/nmz133 · Cited by 6 · see citing works
The loss of the NHS EED and DARE databases and the effect on evidence synthesis and evaluation
Briscoe, S., Cooper, C. W., Glanville, J., et al. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1235 · Cited by 5 · see citing works
Willis, H. L., & Scott, W. G. (2018) · CRC Press eBooks · doi:10.1201/9781315215006-5 · Cited by 3 · see citing works
From the Office of a Systematic Review Consultant
Foster, M. (2018) · HERD Health Environments Research & Design Journal · doi:10.1177/1937586717749905 · Cited by 3 · see citing works
PRISMA-S DraftPreprint
Ayala, A. P., Koffel, J. B., Waffenschmidt, S., et al. (2019) · OSF Preprints (OSF Preprints) · doi:10.17605/osf.io/7ncys · Cited by 3 · see citing works
Paisley, S., Ševa, J., Stevenson, M., et al. (2016) · Value in Health · doi:10.1016/j.jval.2016.09.120 · Cited by 2 · see citing works
Golder, S., & Wright, K. E. (2016) · Springer eBooks · doi:10.1007/978-3-319-25655-9_7 · Cited by 2 · see citing works
The Retrieval and Assessment of Primary Research
Paterson, B. L., Thorne, S. E., Canam, C., et al. (2001) · Sage eBooks · doi:10.4135/9781412985017.n3 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 13
- COSMIN. (n.d.) Guideline for systematic reviews of outcome measurement instruments. Retrieved from https://www. cosmin.nl/tools/guideline-conducting-systematic-review-outcome- measures/?portfolioCats=19
- de, Vet, H. C. W., Eisinga, A., Riphagen, I. I., Aertgeerts, B., & Pewsner, D. (2008). Chapter 7: Searching for studies. In Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 0.4 [updated September 2008].
- © 2019 Health Libraries Group Health Information & Libraries Journal, 36, pp. 202-222 Meeting the review family, Anthea Sutton et al. 217 14711842, 2019, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/hir.12276, Wiley Online Library on [05/08/2026]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
- Dobbins, M. (2017). Rapid review guidebook. Hamilton, ON: National Collaborating Centre for Methods and Tools. Retrieved from https://www.nccmt.ca/capacity-development/ rapid-review-guidebook.
- Duncan, V., et al. (2017). Working with a librarian on a realist review: The RAMESES Project. Retrieved from http://www.ra mesesproject.org/media/RAMESES_II_Working_with_a_libra rian.pdf
- ED000091 · DOI
- France, E., & the eMERGe Project Team and Advisors. (2018). Introducing the first bespoke Meta-ethnography Reporting Guidance (eMERGe). In IIQM 24th Annual Qualitative Health Research Conference, Halifax, Nova Scotia, 27.10.2018-29.10.2018.
- J. Glanville, C. Lefebvre, & K. Wright (Eds.). (2008). ISSG search filter resource. York, UK: The InterTASC Information Specialists' Sub-Group; [updated 2019 May 7; cited 30 May 2019]. Retrieved from: https://sites.google.com/ a/york.ac.uk/issg-search-filters-resource/home
- Lefebvre, C., Glanville, J., Briscoe, S., Littlewood, A., Marshall, C., Metzendorf, M. I., Noel-Storr, A., Rader, T., Shokraneh, F., Thomas, J., & Wieland, L. S. (2019). Chapter 4: Searching for and selecting studies. Draft version (29 January 2019) for inclusion. In J. P. T. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. J. Page, & V. A. Welch (Eds.), Cochrane handbook for systematic reviews for interventions. London: Cochrane.
- pmed1000097 · DOI
- Sampson, M., McGowan, J., Lefebvre, C., Moher, D., & Grimshaw, J. M. (2008). PRESS: Peer review of electronic search strategies. Ottawa, Canada: Canadian Agency for Drugs and Technologies in Health. Retrieved from https:// www.cadth.ca/resources/finding-evidence/press
- The Cochrane Collaboration. (2019). Cochrane review. In The Cochrane Glossary. Retrieved from https://community.cochra ne.org/glossary#letter-C The Pubmed Health Team. (2015). Systematic review methods filter at PubMed. Retrieved from https://www.ncbi.nlm. nih.gov/pubmedhealth/researchers/pubmed-systematic-review- methods-filter/
- Wright, J., & Walwyn, R. (2016). Literature search methods for an overview of reviews ('umbrella' reviews or 'review of reviews'). CILIP Health Libraries Group Conference; 15-16th Sept 2016;
Cited by
Sorted by citations
Updated methodological guidance for the conduct of scoping reviews
Peters, M. D. J., Marnie, C., Tricco, A. C., Pollock, D., Munn, Z., Alexander, L., McInerney, P., Godfrey, C. M., & Khalil, H. (2020) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00167 · Cited by 7,751 · see citing works
Updated methodological guidance for the conduct of scoping reviews
Peters, M. D. J., Marnie, C., Tricco, A. C., Pollock, D., Munn, Z., Alexander, L., McInerney, P., Godfrey, C. M., & Khalil, H. (2021) · JBI Evidence Implementation · doi:10.1097/xeb.0000000000000277 · Cited by 1,461 · see citing works
Scoping reviews: reinforcing and advancing the methodology and application
Peters, M. D. J., Marnie, C., Colquhoun, H., Garritty, C. M., Hempel, S., Horsley, T., Langlois, E. V., Lillie, E., O’Brien, K. K., Tunçalp, Ӧ., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01821-3 · Cited by 887 · see citing works
Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00436-z · Cited by 852 · see citing works
“Whilst not included in the Sutton et al. (2019) framework, their ability to provide insight into a field arguably necessitates their inclusion as a valuable form of evidence synthesis.”
BackgroundMethodInfluentialCheong, B. C. (2024) · Frontiers in Human Dynamics · doi:10.3389/fhumd.2024.1421273 · Cited by 445 · see citing works
Conducting high quality scoping reviews-challenges and solutions
Khalil, H., Peters, M. D., Tricco, A. C., Pollock, D., Alexander, L., McInerney, P., Godfrey, C. M., & Munn, Z. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.10.009 · Cited by 305 · see citing works
Banihashem, S. K., Bond, M., Bergdahl, N., Khosravi, H., & Noroozi, O. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00548-8 · Cited by 82 · see citing works
Scoping reviews and rapid reviews
Sabiston, C. M., Vani, M., de Jonge, M., & Nesbitt, A. (2022) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1964095 · Cited by 74 · see citing works
Learning About AI: A Systematic Review of Reviews on AI Literacy
Zhang, S., Ganapathy Prasad, P., & Schroeder, N. L. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251342081 · Cited by 62 · see citing works
Retracted systematic reviews continued to be frequently cited: a citation analysis
Wang, Z., Shi, Q., Zhou, Q., Zhao, S., Hou, R., Lu, S., Gao, X., & Chen, Y. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.05.013 · Cited by 13 · see citing works
RetractedMurukesu, R. R., Alkaff, Z. A., Bridges, C., & Spitschan, M. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd016157 · Cited by 5 · see citing works
“We will also apply the systematic review filter (see Supplementary material 1) developed to identify systematic reviews in MEDLINE (Ovid) outlined by the University of Pittsburgh Health Sciences Library System Guide [82, 83].”
- Authors
- Sutton, A., Clowes, M., Preston, L., & Booth, A.
- Affiliations
- University of Sheffield (GB)
- Corresponding author
- Sutton, Anthea
- Venue
- Health Information & Libraries Journal
- Publisher
- Wiley
- Published
- 2019-09
- Volume
- 36
- Issue
- 3
- Pages
- 202-222
- ISSN
- 1471-1834 (ISSN-L)
- 1471-1842
- OpenAlex
- W2973631095
- Cited by
- 570
- References
- 121
- Citations by year
- 2026: 84 · 2025: 109 · 2024: 109 · 2023: 108 · 2022: 76 · 2021: 56 · 2020: 25 · 2019: 3
- FWCI
- 8.11
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Health Information & Libraries Journal (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Keywords
- review types, information retrieval, search strategies, systematic reviews, health information, evidence identification
- MeSH terms
- Humans, Review Literature as Topic, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
