The DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index, and 1 are not checked yet.
Citation searching: a systematic review case study of multiple risk behaviour interventions
Open accessAbstract
BACKGROUND: The value of citation searches as part of the systematic review process is currently unknown. While the major guides to conducting systematic reviews state that citation searching should be carried out in addition to searching bibliographic databases there are still few studies in the literature that support this view. Rather than using a predefined search strategy to retrieve studies, citation searching uses known relevant papers to identify further papers. METHODS: We describe a case study about the effectiveness of using the citation sources Google Scholar, Scopus, Web of Science and OVIDSP MEDLINE to identify records for inclusion in a systematic review.We used the 40 included studies identified by traditional database searches from one systematic review of interventions for multiple risk behaviours. We searched for each of the included studies in the four citation sources to retrieve the details of all papers that have cited these studies.We carried out two analyses; the first was to examine the overlap between the four citation sources to identify which citation tool was the most useful; the second was to investigate whether the citation searches identified any relevant records in addition to those retrieved by the original database searches. RESULTS: The highest number of citations was retrieved from Google Scholar (1680), followed by Scopus (1173), then Web of Science (1095) and lastly OVIDSP (213). To retrieve all the records identified by the citation tracking searching all four resources was required. Google Scholar identified the highest number of unique citations.The citation tracking identified 9 studies that met the review's inclusion criteria. Eight of these had already been identified by the traditional databases searches and identified in the screening process while the ninth was not available in any of the databases when the original searches were carried out. It would, however, have been identified by two of the database search strategies if searches had been carried out later. CONCLUSIONS: Based on the results from this investigation, citation searching as a supplementary search method for systematic reviews may not be the best use of valuable time and resources. It would be useful to verify these findings in other reviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Greenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045 · cited 1×
“One study [7] audited the sources used in a systematic review of complex evidence i.”
BackgroundFinding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 943
Three options for citation tracking: Google Scholar, Scopus and Web of Science
Bakkalbasi, N., Bauer, K., Glover, J., & Wang, L. (2006) · Biomedical Digital Libraries · doi:10.1186/1742-5581-3-7 · Cited by 752
Searching for studies: a guide to information retrieval for Campbell systematic reviews
Kugley, S., Wade, A., Thomas, J., Mahood, Q., Jørgensen, A. K., Hammerstrøm, K., & Sathe, N. (2017) · Campbell Systematic Reviews · doi:10.4073/cmg.2016.1 · Cited by 371
Papaioannou, D., Sutton, A., Carroll, C., Booth, A., & Wong, R. (2010) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00863.x · Cited by 318
Kreuter, M. W., & Strecher, V. J. (1996) · Health Education Research · doi:10.1093/her/11.1.97 · Cited by 305
Improving Multiple Behaviors for Colorectal Cancer Prevention Among African American Church Members.
Campbell, M. K., James, A. S., Hudson, M. A., Carr, C., Jackson, E., Oakes, V., Demissie, S., Farrell, D. W., & Tessaro, I. A. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.492 · Cited by 243
de Vries, H., Kremers, S., Smeets, T., Brug, J., & Eijmael, K. (2008) · American Journal of Health Promotion · doi:10.4278/ajhp.22.6.417 · Cited by 215
Spring, B., Schneider, K., McFadden, H. G., Vaughn, J., Kozak, A. T., Smith, M., Moller, A. C., Epstein, L. H., DeMott, A., Hedeker, D., et al. (2012) · Archives of Internal Medicine · doi:10.1001/archinternmed.2012.1044 · Cited by 208
Hui, A. L., Back, L., Ludwig, S. M., Gardiner, P. F., Sevenhuysen, G. P., Dean, H., Sellers, E. A. C., McGavock, J., Morris, M. E., Bruce, S. G., et al. (2011) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2011.03184.x · Cited by 202
Franko, D. L., Cousineau, T. M., Trant, M., Green, T. C., Rancourt, D., Thompson, D., Ainscough, J. L., Mintz, L. B., & Ciccazzo, M. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2008.06.013 · Cited by 184
Coverage of Google Scholar, Scopus, and Web of Science: A case study of the h-index in nursing
Groote, S. L. D., & Raszewski, R. (2012) · Nursing Outlook · doi:10.1016/j.outlook.2012.04.007 · Cited by 162
Oenema, A., Brug, J., Dijkstra, A., de Weerdt, I., & de Vries, H. (2008) · Annals of Behavioral Medicine · doi:10.1007/s12160-008-9023-1 · Cited by 159
The Faith, Activity, and Nutrition Program
Wilcox, S., Parrott, A. W., Baruth, M., Laken, M. A., Condrasky, M. D., Saunders, R. P., Dowda, M. C., Evans, R., Addy, C. L., Warren, T. Y., et al. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.09.062 · Cited by 150
Salamone, L. M., Cauley, J. A., Black, D. M., Simkin‐Silverman, L. R., Lang, W., Gregg, E. W., Palermo, L., Epstein, R. S., Kuller, L. H., & Wing, R. R. (1999) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/70.1.97 · Cited by 143
Impact of an Online Healthful Eating and Physical Activity Program for College Students
Greene, G. W., White, A. A., Hoerr, S. L., Lohse, B., Schembre, S. M., Riebe, D. A., Patterson, J., Kattelmann, K. K., Shoff, S. M., Horacek, T. M., et al. (2012) · American Journal of Health Promotion · doi:10.4278/ajhp.110606-quan-239 · Cited by 142
Ruffin, M. T., Nease, D. E., Sen, A., Pace, W. D., Wang, C., Acheson, L. S., Rubinstein, W. S., O'Neill, S., Gramling, R., & for The Family History Impact Trial (fhitr) Group (2011) · The Annals of Family Medicine · doi:10.1370/afm.1197 · Cited by 141
Kypri, K., & McAnally, H. M. (2005) · Preventive Medicine · doi:10.1016/j.ypmed.2005.07.010 · Cited by 138
Rauh, K., Gabriel, E., Kerschbaum, E., Schuster, T., von Kries, R., Amann‐Gassner, U., & Hauner, H. (2013) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-13-151 · Cited by 130
Efficacy of exercise counselling as an aid for smoking cessation: a randomized controlled trial
USSHER, M. H., West, R., McEwen, A., Taylor, A. H., & Steptoe, A. (2003) · Addiction · doi:10.1046/j.1360-0443.2003.00346.x · Cited by 114
Searching for studies: A guide to information retrieval for Campbell systematic reviews
MacDonald, H. R., Comer, C., Foster, M., Labelle, P., Marsalis, S. E., Nyhan, K., Premji, Z., Rogers, M., Splenda, R., Stansfield, C., et al. (2024) · Campbell Systematic Reviews · doi:10.1002/cl2.1433 · Cited by 113
Provider Counseling, Health Education, and Community Health Workers: The Arizona WISEWOMAN Project
Staten, L. K., Gregory-Mercado, K. Y., Ranger-Moore, J., Will, J. C., Giuliano, A. R., Ford, E. S., & Marshall, J. (2004) · Journal of Women's Health · doi:10.1089/1540999041281133 · Cited by 110
The Efficacy of an HIV Risk Reduction Intervention for Hispanic Women
Peragallo, N. P., Gonzalez-Guarda, R. M., McCabe, B. E., & Cianelli, R. (2011) · AIDS and Behavior · doi:10.1007/s10461-011-0052-6 · Cited by 94
Keyserling, T. C., Samuel‐Hodge, C. D., Jilcott, S. B., Johnston, L. F., Garcia, B. A., Gizlice, Z., Gross, M. D., Saviñon, C. E., Bangdiwala, S. I., Will, J. C., et al. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2008.02.011 · Cited by 90
Randomized controlled study of a retiree health promotion program. The Bank of American Study
Leigh, J. P. (1992) · Archives of Internal Medicine · doi:10.1001/archinte.152.6.1201 · Cited by 87
Burke, L., Lee, A. H., Jancey, J. M., Xiang, L., Kerr, D. A., Howat, P. A., Hills, A. P., & Anderson, A. S. (2013) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-10-14 · Cited by 84
Vandelanotte, C., Reeves, M. M., Brug, J., & De Bourdeaudhuij, I. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2007.07.008 · Cited by 80
Wilkinson, S. A., & McIntyre, D. H. (2012) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-12-131 · Cited by 78
van Keulen, H. M., Mesters, I., Ausems, M., van Breukelen, G., Campbell, M. K., Resnicow, K., Brug, J., & de Vries, H. (2010) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9231-3 · Cited by 78
Development and Evaluation of an HIV-Risk Reduction Program for Female College Students
Sikkema, K. J., Winett, R. A., & Lombard, D. N. (1995) · AIDS Education and Prevention · doi:10.1521/aeap.1995.7.2.145 · Cited by 78
Emmons, K. M., Stoddard, A. M., Fletcher, R. H., Gutheil, C. M., Suarez, E. G., Lobb, R., Weeks, J. C., & Bigby, J. A. (2005) · American Journal of Public Health · doi:10.2105/ajph.2004.038695 · Cited by 77
Burton, L. C., Paglia, M. J., German, P. S., Shapiro, S., Damiano, A. M., Steinwachs, D. M., Kasper, J. D., Fried, L. P., Levine, D. M., Tsuji, I., et al. (1995) · Preventive Medicine · doi:10.1006/pmed.1995.1078 · Cited by 74
Weisman, C. S., Hillemeier, M. M., Downs, D. S., Feinberg, M. E., Chuang, C. H., Botti, J. J., & Dyer, A.-M. (2011) · Women's Health Issues · doi:10.1016/j.whi.2011.03.007 · Cited by 67
The behavioral and clinical effects of therapeutic lifestyle change on middle-aged adults.
Aldana, S. G., Greenlaw, R. L., Diehl, H. A., Salberg, A., Merrill, R. M., Ohmine, S., & Thomas, C. (2006) · Europe PMC (PubMed Central) · Cited by 64
LaChausse, R. G. (2012) · Journal of American College Health · doi:10.1080/07448481.2011.623333 · Cited by 64
Parekh, S., Vandelanotte, C., King, D. B., & Boyle, F. M. (2012) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-9-108 · Cited by 57
Are effects from a brief multiple behavior intervention for college students sustained over time?
Werch, C. E., Moore, M., Bian, H., DiClemente, C. C., Huang, I., Ames, S. C., Thombs, D. L., Weiler, R. M., & Pokorny, S. B. (2009) · Preventive Medicine · doi:10.1016/j.ypmed.2009.12.010 · Cited by 46
Short-term Impact of an HIV Risk Reduction Intervention for Soon-to-be Released Inmates in Georgia
Braithwaite, R. L., Stephens, T., Treadwell, H. M., Braithwaite, K., & Conerly, R. C. (2005) · Journal of Health Care for the Poor and Underserved · doi:10.1353/hpu.2005.0111 · Cited by 42
Simkin‐Silverman, L. R., Wing, R. R., Boraz, M. A., Meilahn, E. N., & Kuller, L. H. (1998) · PubMed · Cited by 39
Results of the Dutch Community Project "Healthy Bergeyk"
Vanassema, P., Steenbakkers, M. W. H. L., Kok, G., Eriksen, M. P., & Devries, H. (1994) · Preventive Medicine · doi:10.1006/pmed.1994.1054 · Cited by 38
Lombard, C. B., Deeks, A. A., Jolley, D., & Teede, H. J. (2009) · BMC Public Health · doi:10.1186/1471-2458-9-2 · Cited by 38
Burgess, A. W., & Holmstrom, L. L. (1979) · Women & Health · doi:10.1300/j013v04n03_04 · Cited by 36
Cluster randomised trial of the effectiveness of Motivational Interviewing for universal prevention
McCambridge, J., Hunt, C., Jenkins, R. J., & Strang, J. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2010.07.028 · Cited by 30
Jacobs, N., Clays, E., Bacquer, D. D., Backer, G. D., Dendale, P., Thijs, H., Bourdeaudhuij, I. D., & Claes, N. (2011) · Health Education Research · doi:10.1093/her/cyr046 · Cited by 28
Hillier-Brown, F. C., Batterham, A. M., Nixon, C., Crayton, A. M., Pedley, C., & Summerbell, C. D. (2011) · Public Health Nutrition · doi:10.1017/s1368980011002862 · Cited by 26
Efficacy of a Health-Promotion Intervention for College Students
Díez, S. U., Fortis, A. P., & Franco, S. F. (2012) · Nursing Research · doi:10.1097/nnr.0b013e3182475aaa · Cited by 25
Zhou, B., Chen, K., Yu, Y.-X., Wang, H., Zhang, S.-S., & Zheng, W.-J. (2010) · Educational Gerontology · doi:10.1080/03601271003689514 · Cited by 11
Randomized Controlled Study of a Retiree Health Promotion Program
Leigh, J. P. (1992) · Archives of Internal Medicine · doi:10.1001/archinte.1992.00400180067010
Research works printed but not linked: 2
- Higgins J, Green S: Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. 2011, The Cochrane Collaboration, Available from: http://www.cochrane-handbook.org
- Campo Osaba MA: Actividad comunitaria de promocion de la salud: resultados de un ensayo clinicoIn V Premios Steve. Unidos por la Atencion al Paciente. Barcelona (Spain). Ediciones Mayo. 2013, 54-63. http://www.esteve.es/EsteveArchivos/premiosesteve/2012/entrega/index.html#/94/ ,
Cited by
Sorted by citations
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., & Koffel, J. (2019) · doi:10.31219/osf.io/sfc38 · Cited by 3,696
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., PRISMA-S Group, Blunt, H., Brigham, T., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01542-z · Cited by 3,714
Self-citationHaddaway, N. R., Grainger, M. J., & Gray, C. T. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1563 · Cited by 604
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., & PRISMA-S Group (2021) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2021.962 · Cited by 525
Smartphone addiction is increasing across the world: A meta-analysis of 24 countries
Olson, J. A., Sandra, D. A., Colucci, É. S., Bikaii, A. A., Chmoulevitch, D., Nahas, J., Raz, A., & Veissière, S. P. L. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107138 · Cited by 474
Metadata
- Authors
- Wright, K., Golder, S., & Rodriguez-Lopez, R.
- Affiliations
- University of York (GB)
- Corresponding author
- Wright, Kath
- Venue
- BMC Medical Research Methodology
- Published
- 2014-06-03
- Volume
- 14
- Issue
- 1
- Pages
- 73-73
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC4048585
- OpenAlex
- W2041004369
- Cited by
- 103
- References
- 50
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 18 · 2023: 15 · 2022: 17 · 2021: 8 · 2020: 5 · 2019: 7 · 2018: 6 · 2017: 6 · 2016: 4 · 2015: 2 · 2014: 2
- FWCI
- 1.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- citation searching, citation tracking, systematic review search strategy, bibliographic database searching, Google Scholar, Scopus, Web of Science, MEDLINE, multiple risk behaviors
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Risk-Taking, Databases, Bibliographic, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
