Searching for and selecting studies
Open accessAbstract
This chapter outlines some general issues in searching for studies; describes the main sources of potential studies; and discusses how to plan the search process, design and carry out search strategies, manage references found during the search process, correctly document the search process and select studies from the search results. It provides advice and guidance for medical/healthcare librarians and information specialists (within and beyond Cochrane) involved in the search process to identify studies for inclusion in systematic reviews. For review authors, alerts are a useful tool to help monitor what is being published in their review topic after the original search has been conducted. By following the alert, authors can become aware of a new study that meets the review's eligibility criteria, and decide either to include it in the review immediately or mention it as a ‘study awaiting assessment’ for inclusion during the next review update.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement
McGowan, J., Sampson, M., Salzwedel, D. M., Cogo, E., Foerster, V., & Lefebvre, C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.021 · Cited by 5,700 · see citing works
Self-citationSystematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586 · see citing works
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · see citing works
The well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931 · see citing works
The role of google scholar in evidence reviews and its applicability to grey literature searching
Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138237 · Cited by 2,387 · see citing works
Greenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045 · see citing works
<i>meta-analysis</i> bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374 · see citing works
Morrison, A., Polisena, J., Husereau, D., Moulton, K., Clark, M., Fiander, M., Mierzwinski-Urban, M., Clifford, T., Hutton, B., & Rabb, D. (2012) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462312000086 · Cited by 1,257 · see citing works
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028 · see citing works
Impact of covert duplicate publication on meta-analysis: a case study
Tramèr, M. R., Reynolds, D. J. M., Moore, R. A., & McQuay, H. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.635 · Cited by 702 · see citing works
Royle, P., & Milne, R. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000552 · Cited by 693 · see citing works
Authority, E. G. F. T. C. O. S. R. E. F. S. (2010) · EFSA Journal · doi:10.2903/j.efsa.2010.1637 · Cited by 693 · see citing works
Do Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials
Vickers, A. J., Goyal, N., Harland, R., & Rees, R. W. (1998) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00150-5 · Cited by 684 · see citing works
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681 · see citing works
Self-citationBooth, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0249-x · Cited by 587 · see citing works
Moher, D., Pham, B., Lawson, M., & Klassen, T. (2003) · Health Technology Assessment · doi:10.3310/hta7410 · Cited by 500 · see citing works
The Science of Reviewing Researcha
OXMAN, A. D., & GUYATT, G. H. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26342.x · Cited by 472 · see citing works
Systematic review automation technologies
Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-74 · Cited by 472 · see citing works
Failure of Investigational Drugs in Late-Stage Clinical Development and Publication of Trial Results
Hwang, T. J., Carpenter, D. P., Lauffenburger, J. C., Wang, B., Franklin, J. M., & Kesselheim, A. S. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.6008 · Cited by 445 · see citing works
Marshall, I. J., Noel‐Storr, A., Kuiper, J., Thomas, J., & Wallace, B. C. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1287 · Cited by 435 · see citing works
Self-citationLiving systematic reviews: 2. Combining human and machine effort
Thomas, J., Noel-Storr, A., Marshall, I., Wallace, B., McDonald, S., Mavergames, C., Glasziou, P., Shemilt, I., Synnot, A., Turner, T., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.011 · Cited by 355 · see citing works
Self-citationO’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0031-5 · Cited by 351 · see citing works
Self-citationEdwards, P., Clarke, M., DiGuiseppi, C., Pratap, S., Roberts, I., & Wentz, R. (2002) · Statistics in Medicine · doi:10.1002/sim.1190 · Cited by 340 · see citing works
Rethlefsen, M. L., Farrell, A. M., Osterhaus Trzasko, L. C., & Brigham, T. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.025 · Cited by 331 · see citing works
Hartling, L., Featherstone, R. M., Nuspl, M., Shave, K., Dryden, D. M., & Vandermeer, B. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0347-z · Cited by 325 · see citing works
Different Patterns of Duplicate Publication: An Analysis of Articles Used in Systematic Reviews
von Elm, E., Poglia, G., Walder, B., & Tramèr, M. R. (2004) · JAMA · doi:10.1001/jama.291.8.974 · Cited by 290 · see citing works
Unpublished Research From a Medical Specialty Meeting
Weber, E. J., Callaham, M. L., Wears, R. L., Barton, C., & Young, G. P. (1998) · JAMA · doi:10.1001/jama.280.3.257 · Cited by 262 · see citing works
Should Unpublished Data Be Included in Meta-analyses?: Current Convictions and Controversies
Cook, D. J. (1993) · JAMA · doi:10.1001/jama.1993.03500210049030 · Cited by 259 · see citing works
Viergever, R. F., & Li, K. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008932 · Cited by 228 · see citing works
Discontinuation and non-publication of surgical randomised controlled trials: observational study
Chapman, S. J., Shelton, B., Mahmood, H., Fitzgerald, J. E. F., Harrison, E. M., & Bhangu, A. A. (2014) · BMJ · doi:10.1136/bmj.g6870 · Cited by 221 · see citing works
Publication of Clinical Trials Supporting Successful New Drug Applications: A Literature Analysis
Lee, K., Bacchetti, P., & Sim, I. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050191 · Cited by 215 · see citing works
Pham, B., Klassen, T. P., Lawson, M. L., & Moher, D. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.08.021 · Cited by 206 · see citing works
Restoring invisible and abandoned trials: a call for people to publish the findings
Doshi, P., Dickersin, K., Healy, D., Vedula, S. S., & Jefferson, T. (2013) · BMJ · doi:10.1136/bmj.f2865 · Cited by 189 · see citing works
Identifying Clinical Trials in the Medical Literature with Electronic Databases
Suarez-Almazor, M. E., Belseck, E. M., Homik, J., Dorgan, M., & Ramos-Remus, C. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00067-2 · Cited by 179 · see citing works
Scherer, R. W., Ugarte‐Gil, C., Schmucker, C. M., & Meerpohl, J. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.01.027 · Cited by 176 · see citing works
Going, Going, Gone: Lost Internet References
Dellavalle, R. P., Hester, E. J., Heilig, L. F., Drake, A. L., Kuntzman, J., Graber, M., & Schilling, L. M. (2003) · Science · doi:10.1126/science.1088234 · Cited by 173 · see citing works
Shemilt, I., Simon, A., Hollands, G. J., Marteau, T. M., Ogilvie, D., O'Mara‐Eves, A., Kelly, M. P., & Thomas, J. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1093 · Cited by 170 · see citing works
Self-citationShemilt, I., Khan, N., Park, S., & Thomas, J. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0315-4 · Cited by 168 · see citing works
Self-citationHalladay, C. W., Trikalinos, T. A., Schmid, I. T., Schmid, C. H., & Dahabreh, I. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.017 · Cited by 166 · see citing works
Should meta-analysts search Embase in addition to Medline?
Sampson, M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00110-0 · Cited by 160 · see citing works
Bidirectional Citation Searching to Completion: An Exploration of Literature Searching Methods
Hinde, S., & Spackman, E. (2014) · PharmacoEconomics · doi:10.1007/s40273-014-0205-3 · Cited by 145 · see citing works
Searching multiple databases for systematic reviews: added value or diminishing returns?
Stevinson, C., & Lawlor, D. A. (2004) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2004.09.003 · Cited by 143 · see citing works
Errors in search strategies were identified by type and frequency
Sampson, M., & McGowan, J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.007 · Cited by 142 · see citing works
Analysis of the reporting of search strategies in Cochrane systematic reviews
Yoshii, A., Plaut, D. A., McGraw, K. A., Anderson, M. J., & Wellik, K. E. (2009) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.97.1.004 · Cited by 137 · see citing works
Sampson, M., Zhang, L., Morrison, A., Barrowman, N. J., Clifford, T., Platt, R. W., Klassen, T. P., & Moher, D. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-33 · Cited by 133 · see citing works
Wieseler, B., Kerekes, M. F., Vervoelgyi, V., McGauran, N., & Kaiser, T. (2012) · BMJ · doi:10.1136/bmj.d8141 · Cited by 129 · see citing works
Atkinson, K. M., Koenka, A. C., Sanchez, C. E., Moshontz, H., & Cooper, H. M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1127 · Cited by 126 · see citing works
Hetherington, J., Dickersin, K., Chalmers, I., & Meinert, C. L. (1989) · PEDIATRICS · doi:10.1542/peds.84.2.374 · Cited by 124 · see citing works
Cultures of evidence across policy sectors: systematic review of qualitative evidence
Lorenc, T., McGill, E., Petticrew, M. P., et al. (2014) · European Journal of Public Health · doi:10.1093/eurpub/cku038 · Cited by 122 · see citing works
The contribution of databases to the results of systematic reviews: a cross-sectional study
Hartling, L., Featherstone, R., Nuspl, M., Shave, K., Dryden, D. M., & Vandermeer, B. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0232-1 · Cited by 118 · see citing works
Lefebvre, C., Glanville, J., Wieland, L. S., Coles, B., & Weightman, A. L. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-78 · Cited by 112 · see citing works
Self-citationMeert, D., Torabi, N., & Costella, J. (2016) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.104.4.004 · Cited by 108 · see citing works
Methods for obtaining unpublished data
Young, T., & Hopewell, S. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000027.pub2 · Cited by 107 · see citing works
Baudard, M., Yavchitz, A., Ravaud, P., Perrodeau, E., & Boutron, I. (2017) · BMJ · doi:10.1136/bmj.j448 · Cited by 107 · see citing works
Doust, J. A., Pietrzak, E., Sanders, S., & Glasziou, P. P. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.011 · Cited by 106 · see citing works
The role of modelling in prioritising and planning clinical trials
Chilcott, J. B., Brennan, A., Booth, A., Karnon, J. D., & Tappenden, P. (2003) · Health Technology Assessment · doi:10.3310/hta7230 · Cited by 99 · see citing works
Lefebvre, C., Eisinga, A., McDonald, S., & Paul, N. (2008) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-5-13 · Cited by 93 · see citing works
Self-citationHow much searching is enough? Comprehensive versus optimal retrieval for technology assessments
Booth, A. (2010) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462310000966 · Cited by 88 · see citing works
Medline and Embase complement each other in literature searches
Woods, D. J., & Trewheellar, K. (1998) · BMJ · doi:10.1136/bmj.316.7138.1166 · Cited by 85 · see citing works
Glanville, J. M., Duffy, S., McCool, R., & Varley, D. (2014) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.102.3.007 · Cited by 75 · see citing works
Self-citationNo consensus exists on search reporting methods for systematic reviews
Sampson, M., McGowan, J., Tetzlaff, J., Cogo, E., & Moher, D. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.009 · Cited by 63 · see citing works
Out of sight but not out of mind: how to search for unpublished clinical trial evidence
Chan, A.-W. (2012) · BMJ · doi:10.1136/bmj.d8013 · Cited by 62 · see citing works
Pharmaceutical companies’ policies on access to trial data, results, and methods: audit study
Goldacre, B. M., Lane, S., Mahtani, K. R., Heneghan, C. J., Onakpoya, I., Bushfield, I., & Smeeth, L. L. (2017) · BMJ · doi:10.1136/bmj.j3334 · Cited by 59 · see citing works
Going, Going, Still There: Using the WebCite Service to Permanently Archive Cited Web Pages
Eysenbach, G., & Trudel, M. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.5.e60 · Cited by 57 · see citing works
Manheimer, E. W., & Anderson, D. (2002) · BMJ · doi:10.1136/bmj.325.7363.528 · Cited by 57 · see citing works
How useful are unpublished data from the Food and Drug Administration in meta-analysis?
MacLean, C. H., Morton, S. C., Ofman, J. J., Röth, E., & Shekelle, P. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00520-6 · Cited by 52 · see citing works
Spoor, P., Airey, M., Bennett, C., Greensill, J., & Williams, R. (1996) · BMJ · doi:10.1136/bmj.313.7053.342 · Cited by 51 · see citing works
Influences on the Outcome of Literature Searches for Integrative Research Reviews
Cooper, H., & Ribble, R. G. (1989) · Science Communication · doi:10.1177/107554708901000301 · Cited by 50 · see citing works
Wu, X., Tang, J.-L., Mao, C., Yuan, J.-Q., Qin, Y., & Chung, V. C. (2013) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2013/812179 · Cited by 50 · see citing works
Identification of problems in search strategies in <scp>C</scp>ochrane <scp>R</scp>eviews
Franco, J. V. A., Garrote, V. L., Escobar Liquitay, C. M., & Vietto, V. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1302 · Cited by 48 · see citing works
Kastner, M., Straus, S. E., McKibbon, K. A., & Goldsmith, C. H. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.06.001 · Cited by 47 · see citing works
Rice, D. B., Kloda, L. A., Levis, B., Qi, B., Kingsland, E., & Thombs, B. D. (2016) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2016.06.002 · Cited by 46 · see citing works
Horton, R. C. (1997) · The Lancet · doi:10.1016/s0140-6736(05)62564-0 · Cited by 45 · see citing works
When to include clinical study reports and regulatory documents in systematic reviews
Jefferson, T., Doshi, P., Boutron, I., Golder, S., Heneghan, C. J., Hodkinson, A., Jones, M., Lefebvre, C., & Stewart, L. A. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2018-110963 · Cited by 45 · see citing works
Self-citationSystematic review toolbox: a catalogue of tools to support systematic reviews
Marshall, C., & Brereton, P. (2015) · Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2745802.2745824 · Cited by 44 · see citing works
Self-citationSearching for unpublished data for Cochrane reviews: cross sectional study
Schroll, J. B., Bero, L., & Gotzsche, P. C. (2013) · BMJ · doi:10.1136/bmj.f2231 · Cited by 43 · see citing works
Köhler, M., Haag, S., Biester, K., Brockhaus, A. C., McGauran, N., Grouven, U., Kölsch, H., Seay, U., Horn, H., Moritz, G., et al. (2015) · BMJ · doi:10.1136/bmj.h796 · Cited by 43 · see citing works
Mullins, M. M., DeLuca, J. B., Crepaz, N., & Lyles, C. M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1098 · Cited by 39 · see citing works
Roundtree, A. K., Kallen, M. A., Lopez-Olivo, M. A., Kimmel, B., Skidmore, B., Ortiz, Z., Cox, V., & Suarez-Almazor, M. E. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.08.003 · Cited by 38 · see citing works
Isojarvi, J., Wood, H., Lefebvre, C., & Glanville, J. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1294 · Cited by 38 · see citing works
Self-citationMethods for documenting systematic review searches: a discussion of common issues
Rader, T., Mann, M., Stansfield, C., Cooper, C., & Sampson, M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1097 · Cited by 37 · see citing works
Self-citationVariation in number of hits for complex searches in Google Scholar
Bramer, W. M. (2016) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.104.2.009 · Cited by 35 · see citing works
"No Language Restrictions" in Database Searches: What Does This Really Mean?
Pilkington, K., Boshnakova, A., Clarke, M. J., & Richardson, J. (2005) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2005.11.205 · Cited by 31 · see citing works
Layton, D. (2017) · The International Journal of Prosthodontics · doi:10.11607/ijp.5193 · Cited by 31 · see citing works
Niederstadt, C., & Droste, S. (2010) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462310001066 · Cited by 30 · see citing works
Wang, Z., Brito, J. P., Τσάπας, Α., Griebeler, M. L., Alahdab, F., & Murad, M. H. (2015) · Clinical Epidemiology · doi:10.2147/clep.s78879 · Cited by 30 · see citing works
VALUE OF DATABASES OTHER THAN MEDLINE FOR RAPID HEALTH TECHNOLOGY ASSESSMENTS
Lorenzetti, D. L., Topfer, L.-A., Dennett, L., & Clement, F. (2014) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462314000166 · Cited by 30 · see citing works
Complementary approaches to searching MEDLINE may be sufficient for updating systematic reviews
Sampson, M., de Bruijn, B., Urquhart, C. J., & Shojania, K. G. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.03.004 · Cited by 28 · see citing works
A review of the reporting of web searching to identify studies for C ochrane systematic reviews
Briscoe, S. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1275 · Cited by 27 · see citing works
Self-citationValue and usability of unpublished data sources for systematic reviews and network meta-analyses
Halfpenny, N. J. A., Quigley, J. M., Thompson, J. C., & Scott, D. A. (2016) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2016-110494 · Cited by 23 · see citing works
Inquisitio validus Index Medicus: A simple method of validating MEDLINE systematic review searches
Sampson, M., & McGowan, J. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.40 · Cited by 22 · see citing works
Chinese Clinical Trial Registry: mission, responsibility and operation
Wu, T., Li, Y., Liu, G., et al. (2011) · Journal of Evidence-Based Medicine · doi:10.1111/j.1756-5391.2011.01137.x · Cited by 22 · see citing works
Craven, J., & Levay, P. (2011) · Evidence Based Library and Information Practice · doi:10.18438/b8cd09 · Cited by 21 · see citing works
Lampert, A., Hoffmann, G. F., & Ries, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0144973 · Cited by 19 · see citing works
An e-mail survey identified unpublished studies for systematic reviews
Revéiz, L., Cardona, A. F., Ospina, É. G., & de Agular, S. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.11.022 · Cited by 16 · see citing works
Knelangen, M., Hausner, E., Metzendorf, M., Sturtz, S., & Waffenschmidt, S. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.003 · Cited by 15 · see citing works
Self-citationFDA: untapped source of unpublished trials
Bennett, D., & Jull, A. (2003) · The Lancet · doi:10.1016/s0140-6736(03)13147-9 · Cited by 12 · see citing works
Neue Erkenntnisse zu Fumarsäureestern (Fumaderm®): Ergebnisse eines Experten‐Workshops
Mrowietz, U., Adamczyk, A., Augustin, M., Boehncke, W., Bonnekoh, B., Gambichler, T., Hengge, U., Lippert, U., Ludwig, R. J., Luger, T. A., et al. (2011) · JDDG Journal der Deutschen Dermatologischen Gesellschaft · doi:10.1111/j.1610-0379.2011.07765.x · Cited by 10 · see citing works
Should Systematic Reviewers Search for Randomized, Controlled Trials Published as Letters?
Iansavichene, A. E., Sampson, M., McGowan, J., & Ajiferuke, I. S. Y. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-9-200805060-00023 · Cited by 9 · see citing works
Review of Cochrane Reviews on Acupuncture: How Chinese Resources Contribute to Cochrane Reviews
Jiao, S., Tsutani, K., & Haga, N. (2013) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2012.0113 · Cited by 6 · see citing works
Clinical trial registries: more international, converging efforts are needed
Pansieri, C., Pandolfini, C., & Bonati, M. R. (2017) · Trials · doi:10.1186/s13063-017-1836-4 · Cited by 6 · see citing works
Is MEDLINE alone enough for a meta‐analysis?
Bai, Y., Gao, J., Zou, D., & Li, Z. (2007) · Alimentary Pharmacology & Therapeutics · doi:10.1111/j.1365-2036.2007.03339.x · Cited by 5 · see citing works
HOW HEALTH TECHNOLOGY ASSESSMENT AGENCIES ADDRESS THE ISSUE OF UNPUBLISHED DATA
Kreis, J., Пантели, Д., & Busse, R. (2014) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646231300072x · Cited by 5 · see citing works
(2012) · Current Medical Research and Opinion · doi:10.1185/03007995.2012.666394 · Cited by 4 · see citing works
Electronic search strategies should be repeatable
Chow, T. (2015) · European Journal of Pain · doi:10.1002/ejp.771 · Cited by 2 · see citing works
Brusselle, G., & Blasi, F. (2014) · Pulmonary Pharmacology & Therapeutics · doi:10.1016/j.pupt.2014.09.006 · Cited by 1 · see citing works
Witkowski, M., & Aldhouse, N. (2015) · Value in Health · doi:10.1016/j.jval.2015.09.2737 · Cited by 1 · see citing works
Certain countries produce only positive trial results
(1999) · Focus on Alternative and Complementary Therapies · doi:10.1211/fact.1999.00055 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 71
- [4]4. Antman, K. H. Searching for truth--from biblical to modern times. Journal of Clinical Oncology, 1986;4(10),:1441-1442.
- [5]5. Assendelft, W. J. J., Van Tulder, M. W., Scholten, R. J. P. M., & Bouter, L. M. The practice of systematic reviews. II. Searching and selection of studies/De praktijk van systematische reviews. II. Zoeken en selecteren van literatuur. Nederlands Tijdschrift voor Geneeskunde, 1996;143(13): 656-661.
- [6]6. Axelsson, C. K. [To colleagues, medical associations and the Danish Medical Society: Clinical research needs help]. Ugeskrift for Laeger, 2010;172(12):985.
- [7]7. Bassler, D., Scholtyssek, C., Forster, J., & Antes, G. [Decreasing the possibilities for bias in selecting studies for pediatric systematic reviews and meta-analyses]. Monatsschrift Kinderheilkunde. 2001; 149(10): 1046-1049.
- [8]8. Berlin, J. A., & Wacholtz, M. C. Selective reporting, publication bias and clinical trial registry: an industry perspective. International Journal of Pharmaceutical Medicine, 2005; 19(5-6): 277-284.
- [9]9. Bestehorn, K., Honig, R., Clemens, N., & Kirch, W. [Registries for clinical trials --a critical stock-taking]. Medizinische Klinik, 2006;101(2):20-126.
- [11]11. Boissel, J. P., & Haugh, M. C. The iceberg phenomenon and publication bias: the editors' fault? Clinical Trials & Meta-Analysis, 1993;28(6):309-315.
- [12]12. Brazilian Registry of Clinical Trials (Rebrac): strengthening of clinical trials management in Brazil. /Registro Brasileiro de Ensaios Clinicos (Rebrac): fortalecimento da gestao de pesquisa clinica no Brasil. Revista de Saude Publica, 2009;43(2):387-388.
- [13]13. Buyse, M., Firket, P., De Conick, A., & Staquet, M. EUROCODE: a computerized network for clinical trials in oncology [abstract]. Controlled Clinical Trials, 1988;9:259.
- [14]14. Carson, J., & Wyatt, H. V. How publishing medical microbiologists acquire information. Medical Laboratory Sciences, 1982; 39(2):165-170.
- [15]15. Davenport, C., Wilson, J., Adi, Y., & Song, F. Ongoing trials in health technology assessment -a survey [abstract]. In: Proceedings of the First Annual Meeting of the Health Technology Assessment International (HTAi); 2004 May 30 -June 2; Krakow, Poland.
- [16]16. Detre, K. What can comparative databases contribute to the evaluation of new technology? Journal of Invasive Cardiology, 1993;5(2):53-59.
- [17]17. Dirk, L. From laboratory to scientific literature. Science Communication, 1996;18(1):3-28.
- [18]18. Dreier, G., Batz, D., & Maier-Lenz, H. Knowing the landscape of clinical trials -are we all talking about the same when talking about clinical trials? [abstract]. Clinical Trials. 2009;6(5): 556-7.
- [19]19. Garattini, S., & Fracchia, G. N. Research perspectives for a European clinical trials network. Report from an EC study group. Clinical Trials & Meta-Analysis, 1993;28(4-5): 241-254.
- [21]21. Hajek, T. Publication bias: are meta-analyses reliable? Psychiatrie. 2002;6(4): 252-254.
- [22]22. Hopewell, S. Impact of grey literature on systematic reviews of randomized trials [PhD Thesis]. Oxford: Wolfson College, University of Oxford, 2004.
- [23]23. Joint Statement Working Group [Joint statement of establishing Chinese clinical trial registration and publishing system]. Zhongguo Zhong Xi Yi Jie He Za Zhi Zhongguo Zhongxiyi Jiehe Zazhi/Chinese Journal of Integrated Traditional & Western Medicine/, 2006;26(7):585-586.
- [24]24. Kirwan, J. R. Making original data from clinical studies available for alternative analysis. Journal of Rheumatology.1997;24(5): 822-825.
- [25]25. Kiuchi, T. [Present status and future directions of clinical trial registration]. Rinsho Ketsueki -Japanese Journal of Clinical Hematology, 2006;47(7):564-570.
- [26]26. Kizaki, M., & Investigators, T. [Current status and future perspectives of the Glivec Registration System established by JSCH/JSH-TARGET]. Rinsho Ketsueki - Japanese Journal of Clinical Hematology, 2007;48(6):468-474.
- [28]28. Meinert, C. L. Toward prospective registration of clinical trials. Controlled Clinical Trials, 1988;9(1):1-5.
- [29]29. Moher, D. Facilitating clinical research in the 1990s and beyond: challenges facing clinical trial registers. Fundamental & Clinical Pharmacology, 1995;9(4):381-383.
- [30]30. Moran, M. L. Using the Internet to find information on geriatric rehabilitation. Topics in Geriatric Rehabilitation. 1999;14(3):15-21.
- [32]32. Nilsson, K. [Do register clinical trials! Only a small number of Swedish academic studies in international registries]. Lakartidningen, 2006;103(21-22):1677-1678.
- [33]33. Olson, C. M. Publication bias. Academic Emergency Medicine. 1994;1(3):207- 209.
- [34]34. Online Databases in the Medical and Life Sciences. Cuadra/Elsevier, 1987.
- [35]35. Oxman, A. D., Sackett, D. L., & Guyatt, G. H. Users' guides to the medical literature. I. How to get started. The Evidence-Based Medicine Working Group. JAMA. 1993;270(17): 2093-2095.
- [36]36. Palmowski-Wolfe, A. M. Regarding registration of clinical trials. Archives of Ophthalmology, 2007;125(6): 853.
- [38]38. Patti, J. A. Research, quality and safety, economics: an international perspective. Journal of the American College of Radiology, 2012;9(1):1.
- [39]39. Per, A. [If approved applications are displayed on the Internet--there is no need for a new trials directory]. Lakartidningen, 2006;103(39):2886.
- [40]40. Petrosino, A., Boruch, R. F., Rounding, C., McDonald, S., & Chalmers, I. The Campbell Collaboration Social, Psychological, Educational and Criminological Trials Register (C2-SPECTR) to facilitate the preparation and maintenance of systematic reviews of social and educational interventions. Evaluation and Research in Education. 2000;14(3-4):206-219.
- [41]41. Piantadosi, S., & Byar, D. P. A proposal for registering clinical trials. Controlled Clinical Trials, 1988;9(1):82-84.
- [42]42. Pihlstrom, B. Public registration of clinical trials: good for patients, good for dentists. Journal of the American Dental Association, 2012;143(1):9-11.
- [43]43. Pihlstrom, B. L. Reporting clinical trial results. Journal of the American Dental Association, 2009;140(1):12,14-15.
- [44]44. Pike, R., Keech, A. C., & Simes, R. J. Clinical trials research in the new millennium: the International Clinical Trials Symposium, Sydney, 21-23 October 2002. Medical Journal of Australia, 2003;178(7):316-317.
- [45]45. Ponce de Leon, S. [Pros and cons of the controlled clinical trials registry]. Revista de Investigacion Clinica, 2005;57(4):496-497.
- [46]46. Pritchard, H. K. Problems in scientific communication: a case study. 5th International Conference of Scientific Editors, Hamburg, Germany. 1987.
- [47]47. Rakowitz, B. [How (in-)complete are study reports?]. Deutsche Medizinische Wochenschrift, 2011;136(15):752.
- [48]48. Rebora, A. Publish in English, a sine qua non. Giornale Italiano di Dermatologia e Venereologia, 1988;123(9):387-391.
- [49]49. Reinhardt, D., Bassler, D., Scholtyssek, C., Forster, J., & Antes, G. Decreasing the possibilities for biases in selecting studies for pediatric systematic reviews and meta-analyses. Monatsschrift fur Kinderheilkunde, 2001;149(10):1046-1049.
- [50]50. Riska, O. [Economic benefit and ethical challenges]. Tidsskrift for den Norske Laegeforening, 2008;128(17):1990.
- [51]51. Rohde, H., Otterbach, C., Putz, T., & Mizrahi, M. Reporting on randomised surgical trials from German as compared with English and American surgeons. Theoretical Surgery.1988;3(3):118-127.
- [52]52. Rosenberg, J. [Your study will be registered--now also with results]. Ugeskrift for Laeger, 2009;171(21):1745.
- [53]53. Rubio Terres, C. [Drug regulation in Spain]. Medicina Clinica, 1992;98(19):741- 748.
- [54]54. Ryder, E. [Clinical trials registry]. Investigacion Clinica, 2004;45(4): 295-296.
- [55]55. Shah, J. B., & Margulis, V. Clinical trials: nationally representative data in urology. Nature Reviews Urology, 2009;6(7):354-355.
- [56]56. Shapiro, S. The decision to publish. Ethical dilemmas. Journal of Chronic Diseases. 1985;28(4): 365-372.
- [57]57. Shultz, M. M. We are what we say. Journal of Gender-Specific Medicine. 2001;4(1):16-19
- [58]58. Silagy, C. Randomised controlled trials: the challenge of Archie Cochrane. Medical Journal of Australia, 1993;158(10):656-657.
- [59]59. Silverman, W. A. Replication of clinical trials. Lancet, 1986;2(8502):348.
- [60]60. Singh, A., & Gautam, J. N. Electronic databases: the Indian scenario. Electronic Library.2004;22(3):249-60.
- [61]61. Smith, M. L. Publication bias and meta-analysis. Evaluation in Education. 1980;4:22-24
- [62]62. Somberg, J. Clinical trials registries. American Journal of Therapeutics, 2003;10(5):309-310.
- [63]63. Somberg, J. Drug trial registries. American Journal of Therapeutics, 2004;11(5):327.
- [64]64. Sommer, B. The file drawer effect and publication rates in menstrual cycle research. Psychology of Women Quarterly, 1987;11(2):233-241.
- [65]65. Subirana, M., Sola, I., Garcia, J. M., Guillamet, A., Paz, E., Gich, I., & Urrutia, G. [Importance of the database in the literature search: the first step in a systematic review]. Enfermeria Clinica, 2002;12(6): 296-300.
- [67]67. Tognoni, G. Registering clinical trials. A proposal for year 2000/Registri di trial. Una proposta per il 2000. Giornale Italiano di Farmacia Clinica, 1999;13(4):237- 239.
- [68]68. Toigo, T. Food and Drug Modernization Act (FDAMA) Section 113: Status report on implementation. Journal of Biolaw and Business, 2004;7(2):12-14.
- [69]69. Troeng, T., & Bergqvist, D. [Catch 22 in research may be eliminated by registration]. LAKARTIDNINGEN, 1995;92(16):1659.
- [70]70. Tse, T., Williams, R. J., & Zarin, D. A. Characterizing sponsor-imposed restrictions on disclosing results of clinical trials [abstract]. Sixth International Congress on Peer Review and Biomedical Publication; 2009 Sept 10-12; Vancouver, BC, Canada.
- [71]71. Turner, E. Multiple publication of positive vs negative trial results in review articles: influence on apparent weight of the evidence [abstract]. Sixth International Congress on Peer Review and Biomedical Publication; 2009 Sept 10-12; Vancouver, BC, Canada.
- [72]72. Voelker, R. Unpublished trial registry. JAMA, 1997;278(14):1142.
- [73]73. Wallace, A. E., Neily, J., Weeks, W. B., & Friedman, M. J. A cumulative meta- analysis of selective serotonin reuptake inhibitors in pediatric depression: did unpublished studies influence the efficacy/safety debate? Journal of Child and Adolescent Psychopharmacology. 2006;16(102): 37-58.
- [74]74. Wilson, J. J., Mick, R., Wei, S. J., Rustgi, A. K., Markowitz, S. D., Hampshire, M., & Metz, J. M. Clinical trial resources on the internet must be designed to reach underrepresented minorities. Cancer Journal, 2006;12(6): 475-81.
- [77]77. Yao, C., Sugino, K., Ohashi, Y., & Gong, Q. [Analysis of clinical trials supported by foreign pharmaceutical industries in China]. Chinese Journal of New Drugs, 2008;17(21):1901-1904.
- [78]78. Zacharski, L. R., & Donati, M. B. Registry of clinical trials of antithrombotic drugs in cancer. The Scientific and Standardization Committee of the International Society on Thrombosis and Haemostasis. Subcommittee on Hemostasis and Malignancy. Thrombosis & Haemostasis, 1989;61(3):526-528.
- [79]79. Zacharski, L. R., Donati, M. B., & Rickles, F. R. Registry of clinical trials of antithrombotic drugs in cancer: second report. The Scientific and Standardization Committee of the International Society on Thrombosis and Haemostasis Subcommittee on Hemostasis and Malignancy. Thrombosis & Haemostasis, 1993;70(2):357-360.
- [80]80. Zanchetti, A., & Mancia, G. Searching for information from unreported trials-- amnesty for the past and prospective meta-analyses for the future. Journal of Hypertension, 1998;16(2):125.
- [81]81. Zeps, N. International Clinical Trials Symposium 2007: improving healthcare in the new millennium. Idrugs, 2007;10(12):874-876.
- [82]82. Zhao, X. L., Liu, M., Yuan, Q., He, L., Wu, B., & Zhang, S. H. How to establish a Chinese clinical controlled trials database of neurology. Chinese Journal of Evidence-Based Medicine. 2003;3(4): 311-314. …(truncated)
Cited by
Sorted by citations
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 11,883 · see citing works
Self-citationRethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., & Koffel, J. (2019) · doi:10.31219/osf.io/sfc38 · Cited by 3,696 · see citing works
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., PRISMA-S Group, Blunt, H., Brigham, T., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01542-z · Cited by 3,714 · see citing works
Self-citationPsychological interventions to foster resilience in healthcare professionals
Kunzler, A. M., Helmreich, I., Chmitorz, A., König, J., Binder, H., Wessa, M., & Lieb, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012527.pub2 · Cited by 390 · see citing works
Teo, E., Hassan, N., Tam, W., & Koh, S. (2022) · Diabetologia · doi:10.1007/s00125-021-05648-4 · Cited by 186 · see citing works
Valizadeh, A., Moassefi, M., Nakhostin-Ansari, A., Hosseini Asl, S. H., Saghab Torbati, M., Aghajani, R., Maleki Ghorbani, Z., & Faghani, S. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01631-8 · Cited by 159 · see citing works
“As a rough conservative estimate, it is believed that titles and abstracts of search results could be screened at a rate of 60–120 per hour [3].”
BackgroundMethodInfluentialStatistical stopping criteria for automated screening in systematic reviews
Callaghan, M. W., & Müller-Hansen, F. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01521-4 · Cited by 121 · see citing works
“This is particularly problematic in systematic reviews because low recall increases the risk of bias [9].”
BackgroundMathew, A., Doorenbos, A. Z., Jang, M. K., & Hershberger, P. E. (2021) · Journal of Cancer Survivorship · doi:10.1007/s11764-020-00938-z · Cited by 91 · see citing works
“In view of this finding, and as recommended by the Cochrane guidelines [31, 32] and Bates [39], a high-recall search using multiple strategies was done to retrieve articles which otherwise could have been missed.”
MethodMatsui, K., Utsumi, T., Aoki, Y., Maruki, T., Takeshima, M., & Takaesu, Y. (2024) · Journal of Medical Internet Research · doi:10.2196/52758 · Cited by 50 · see citing works
Questions and answers about conducting systematic reviews in sport and exercise psychology
Gunnell, K., Poitras, V. J., & Tod, D. (2020) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2019.1695141 · Cited by 45 · see citing works
Brini, S., Brudasca, N. I., Hodkinson, A., Kaluzinska, K., Wach, A., Storman, D., Prokop-Dorner, A., Jemioło, P., & Bala, M. M. (2023) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102236 · Cited by 44 · see citing works
Benchmarking Large Language Models in Evidence-Based Medicine
Li, J., Deng, Y., Sun, Q., Zhu, J., Tian, Y., Li, J., & Zhu, T. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3483816 · Cited by 35 · see citing works
Murtha-Lemekhova, A., Fuchs, J., Ghamarnejad, O., Nikdad, M., Probst, P., & Hoffmann, K. (2021) · Scientific Reports · doi:10.1038/s41598-021-92888-4 · Cited by 36 · see citing works
Joschko, R., Roll, S., Willich, S. N., & Berghöfer, A. (2022) · Systematic Reviews · doi:10.1186/s13643-022-01976-7 · Cited by 19 · see citing works
Psychological treatments for people with epilepsy
Michaelis, R., Tang, V., Nevitt, S. J., Wagner, J. L., Modi, A. C., LaFrance Jr, W. C., Goldstein, L. H., Gandy, M., Bresnahan, R., Valente, K., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012081.pub3 · Cited by 37 · see citing works
Hartley, M., Due, C., & Dorstyn, D. (2022) · Disability and Rehabilitation · doi:10.1080/09638288.2021.1921859 · Cited by 15 · see citing works
Ganzevoort, C. O. W., Wolters, L. H., Hornstra, R., Grieve, C. M., Højgaard, D. R. M. A., Skarphedinsson, G. A., Weidle, B., Waite, P., Bertie, L.-A., Tomlinson, M., et al. (2024) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2024.102940 · Cited by 11 · see citing works
Applications of artificial intelligence in vasculitides: a systematic review
Omar, M., Agbareia, R., Naffaa, M. E., Watad, A., Glicksberg, B. S., Nadkarni, G. N., & Klang, E. (2025) · ACR Open Rheumatology · doi:10.1002/acr2.70016 · Cited by 11 · see citing works
A Scoping Review of Adopted Information Extraction Methods for RCTs.
Aletaha, A., Nemati-Anaraki, L., Keshtkar, A., Sedghi, S., Keramatfar, A., & Korolyova, A. (2023) · Medical Journal of The Islamic Republic of Iran · doi:10.47176/mjiri.37.95 · Cited by 2 · see citing works
Coones Long, R., Listener, L., Young, D., Torres-Ruiz, M. F., Oster, R. T., Thorlakson, J., & Willows, N. (2025) · AlterNative: An International Journal of Indigenous Peoples · doi:10.1177/11771801251334791
“The methods for this systematized review were guided by Lefebvre et al. (2021) in consultation with a Public Services Librarian who is Author 6.”
Pitre, T., Zeraatkar, D., Granton, J., Busse, J., Rochwerg, B., & Guyatt, G. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112514 · Cited by 2 · see citing works
- Authors
- Lefebvre, C., Glanville, J., Briscoe, S., Littlewood, A., Marshall, C., Metzendorf, M., Noel‐Storr, A., Rader, T., Shokraneh, F., Thomas, J., Wieland, L. S., & on behalf of the Cochrane Information Retrieval Methods Group
- ORCID
- Venue
- Cochrane Handbook for Systematic Reviews of Interventions
- Publisher
- Wiley
- Published
- 2019-09-20
- Pages
- 67-107
- OpenAlex
- W2974858420
- Semantic Scholar
- 5dd8573aba428e9294ef63da6ee3bcc9b1ddc2a9
- Cited by
- 647
- References
- 108
- Citations by year
- 2026: 64 · 2025: 82 · 2024: 100 · 2023: 75 · 2022: 83 · 2021: 129 · 2020: 100 · 2019: 12 · 2018: 1 · 2012: 1
- Type
- other
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- Locations
- Research Explorer (The University of Manchester) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Health Professions › Health Information Management › Methodologies in Health Research and Practice
- Keywords
- literature search strategies, systematic reviews, study selection, search alerts, citation management, eligibility criteria, Cochrane Collaboration, medical librarians, information professionals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review