The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources
Open accessAbstract
OBJECTIVE: To describe where papers come from in a systematic review of complex evidence. Method Audit of how the 495 primary sources for the review were originally identified. RESULTS: Only 30% of sources were obtained from the protocol defined at the outset of the study (that is, from the database and hand searches). Fifty one per cent were identified by "snowballing" (such as pursuing references of references), and 24% by personal knowledge or personal contacts. CONCLUSION: Systematic reviews of complex evidence cannot rely solely on protocol-driven search strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“and snowballing is the best approach for identifying sources published in obscure journals according to their study.”
From Guidelines for snowballing in systematic literature studies and a replication in software engineering (2014) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These additional methods were used because prior work by Greehalgh and Peacock [91] found that less efficient methods like snowballing are likely to identify important sources that would otherwise be missed, since predefined protocol driven search strategies cannot solely be relied on.”
From Challenges and barriers in virtual teams: a literature review (2020) · cites this paper as [91]
The cited source says what the claim attributes to it.
In the citing paper
“We piloted the use of a highly structured search strategy using protocol-driven searches across a range of electronic databases but, like Greenhalgh and Peacock [17] found that was this unsatisfactory.”
From Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups (2006) · cites this paper as [17]
The cited source says what the claim attributes to it.
In the citing paper
“Greenhalgh and Peacock [15] applied three different search methods in their research, and concluded that protocol-driven search approaches by themselves are not necessarily the most efficient method regardless of the number of databases used”
From Guidelines for snowballing in systematic literature studies and a replication in software engineering (2014) · cites this paper as [15]
The cited source says what the claim attributes to it.
In the citing paper
“the included articles’ reference lists also were evaluated (using the snowball method) to ensure that all relevant articles were included in the study [21].”
From Advantages and disadvantages of mobile applications for workplace health promotion: A scoping review (2024) · cites this paper as [21]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“After reading the first author ' s reports on the literature, the full research team decided to exclude another 71 articles from the selection that, based on the full text, proved not to meet the inclusion criteria.”
From The Role of School in Adolescents’ Identity Development. A Literature Review (2019) · cites this paper as Greenhalgh and Peacock (2005)
Experimental — accuracy not yet measuredIn the citing paper
“As many relevant studies may be identified in sources other than electronic databases [29,30], searches that extend beyond the standard electronic databases should be considered.”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
Competing interests: none declared.
Hirsch, L. (2006) · Cited by 1,396
Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., Kyriakidou, O., & Peacock, R. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.12.001 · Cited by 913
Self-citationRoyle, P., & Milne, R. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000552 · Cited by 693
Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review
Greenhalgh, T., Robert, G., Bate, P., Macfarlane, F., & Kyriakidou, O. (2007) · Cited by 453
Self-citation
Cited by
Sorted by citations
Items 301–400 of 1,004
The sporting resilience model: A systematic review of resilience in sport performers
Gupta, S., & McCarthy, P. J. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1003053 · Cited by 142
“Reference sections of retained papers were handscanned to ensure thorough search of literature (Greenhalgh and Peacock, 2005).”
BackgroundKo, C.-C., Hung, K.-C., Illias, A. M., Chiu, C., Yu, C.-H., Lin, C.-M., Chen, I.-W., & Sun, C.-K. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1101728 · Cited by 94
“Following the identification of a relevant article, the efficiency of literature search was enhanced by adopting a forward snowballing strategy (Greenhalgh and Peacock, 2005; Vassar et al., 2016) to find additional records through reviewing the reference lists of the retrieved studies for potentially eligible articles…”
MethodPagan, C. A., Karasavvidis, T., LeBrun, D. G., Jang, S. J., MacDessi, S. J., & Vigdorchik, J. M. (2023) · The Journal of Arthroplasty · doi:10.1016/j.arth.2023.03.047 · Cited by 94
du Toit, R., Faal, H. B., Etya’ale, D., Wiafe, B., Mason, I., Graham, R., Bush, S., Mathenge, W. C., & Courtright, P. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-102 · Cited by 98
“Structured searches of PubMed, the Cochrane library, Health Systems Evidence (McMaster Health Forum) and the WHO site were supplemented by gathering data iteratively, using more informal approaches such as ‘snowballing’ [71].”
MethodEcosystem services in the Arctic: a thematic review
Malinauskaite, L., Cook, D., Davíðsdóttir, B., Ögmundardóttir, H., & Roman, J. (2019) · Ecosystem Services · doi:10.1016/j.ecoser.2019.100898 · Cited by 93
Emergency department crowding: towards an agenda for evidence-based intervention: Figure 1
Morris, Z. S., Boyle, A. A., Beniuk, K., & Robinson, S. M. (2011) · Emergency Medicine Journal · doi:10.1136/emj.2010.107078 · Cited by 93
Sammito, S., Hadžić, V., Karakolis, T., Kelly, K. R., Proctor, S. P., Stepens, A., White, G., & Zimmermann, W. O. (2021) · Military Medical Research · doi:10.1186/s40779-021-00357-w · Cited by 93
Progress on image analytics: Implications for tourism and hospitality research
Zhan, L., Cheng, M., & Zhu, J. (2023) · Tourism Management · doi:10.1016/j.tourman.2023.104798 · Cited by 97
Semi‐automating the manual literature search for systematic reviews increases efficiency
Chapman, A. L., Morgan, L. C., & Gartlehner, G. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00865.x · Cited by 97
Saleh, A. A., Ratajeski, M. A., & Bertolet, M. H. (2014) · Evidence Based Library and Information Practice · doi:10.18438/b8dw3k · Cited by 93
Degrie, L., Gastmans, C., Mahieu, L., de Casterlé, B. D., & Denier, Y. (2017) · BMC Medical Ethics · doi:10.1186/s12910-016-0163-8 · Cited by 117
“Finally, we performed two rounds of citation and three rounds of reference tracking until no additional data were found [24, 26, 27].”
Insights into workplace bullying: psychosocial drivers and effective interventions
Escartín, J. (2016) · Psychology Research and Behavior Management · doi:10.2147/prbm.s91211 · Cited by 111
Geophysical upheavals and evolutionary diversification of plant species in the Himalaya
Manish, K., & Pandit, M. K. (2018) · PeerJ · doi:10.7717/peerj.5919 · Cited by 92
Luo, L., Reichow, B., Snyder, P., Harrington, J., & Polignano, J. C. (2020) · Topics in Early Childhood Special Education · doi:10.1177/0271121420935579 · Cited by 112
Brown, N., Critchley, J., Bogowicz, P., Mayige, M. T., & Unwin, N. C. (2012) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2012.09.005 · Cited by 93
O'Connor, A. M. C., Anderson, K. M., Goodell, C. K., & Sargeant, J. M. (2014) · Zoonoses and Public Health · doi:10.1111/zph.12125 · Cited by 102
“Recent methodological work shows the importance of author tracing, using personal contacts and other methods to identify studies (Greenhalgh and Peacock, 2005).”
BackgroundA systematic review of the effect of semaglutide on lean mass: insights from clinical trials
Bikou, A., Dermiki-Gkana, F., Penteris, M., Constantinides, T. K., & Kontogiorgis, C. (2024) · Expert Opinion on Pharmacotherapy · doi:10.1080/14656566.2024.2343092 · Cited by 97
“All references from the selected studies were retrieved and manually reviewed according to the snowball effect [22].”
MethodSystematic reviews: from ‘bare bones’ reviews to policy relevance
Snilstveit, B. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.709875 · Cited by 94
“Extensive searching of the grey literature, hand searching of books and journals, snowballing and contacting experts have been found to be particularly important in identifying studies for inclusion (Greenhalgh and Peacock 2005 , Thomas and Harden 2008 ).”
BackgroundCultural adaptations to augment health and mental health services: a systematic review
Healey, P., Stager, M. L., Woodmass, K., Dettlaff, A. J., Vergara, A., Janke, R., & Wells, S. J. (2017) · BMC Health Services Research · doi:10.1186/s12913-016-1953-x · Cited by 98
López‐Pérez, G., Sánchez, I., & Gómez, J. L. Z. (2023) · Business Strategy and the Environment · doi:10.1002/bse.3550 · Cited by 113
Making change last? Exploring the value of sustainability approaches in healthcare: a scoping review
Lennox, L., Linwood-Amor, A., Maher, L., & Reed, J. E. (2020) · Health Research Policy and Systems · doi:10.1186/s12961-020-00601-0 · Cited by 101
Gottschalk, L. B., & Ortaylı, N. (2014) · Contraception · doi:10.1016/j.contraception.2014.04.017 · Cited by 89
“Evaluation of the effectiveness of systematic review protocols has indicated that such nonstandardized techniques like snowballing and utilization of personal networks are both effective and efficient methods of reviewing the complex evidence base [15].”
BackgroundEmotional intelligence and affective events in nurse education: A narrative review
Lewis, G. M., Neville, C. C., & Ashkanasy, N. M. (2017) · Nurse Education Today · doi:10.1016/j.nedt.2017.04.001 · Cited by 110
Open innovation in software engineering: a systematic mapping study
Munir, H., Wnuk, K., & Runeson, P. (2015) · Empirical Software Engineering · doi:10.1007/s10664-015-9380-x · Cited by 88
“Identification of 15 control papers (De Almeida Biolchini et al. 2007) from forward snowball sampling (Greenhalgh and Peacock 2005; Jalali and Wohlin 2012).”
Gleaves, J. T., Petróczi, A., Folkerts, D., de Hon, O. M., Macedo, E., Saugy, M., & Cruyff, M. (2021) · Sports Medicine · doi:10.1007/s40279-021-01477-y · Cited by 88
Review on self-regulated learning in smart learning environment
Gambo, Y., & Shakir, M. Z. (2021) · Smart Learning Environments · doi:10.1186/s40561-021-00157-8 · Cited by 88
“” Also, including reviewing references and citations in the systematic review (Greenhalgh & Peacock, 2005).”
BackgroundMethodLi, H., Zhang, X., Bi, S., Cao, Y., & Zhang, G. (2022) · Urban forestry & urban greening · doi:10.1016/j.ufug.2022.127458 · Cited by 105
How much searching is enough? Comprehensive versus optimal retrieval for technology assessments
Booth, A. (2010) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462310000966 · Cited by 88
“, searching the gray literature, the Internet etcetera) rather than searching increasing numbers of bibliographic databases (simply because this is where there is light) and retrieving ever-diminishing returns (9).”
BackgroundSchoenfeld, B. J., & Grgić, J. (2020) · SAGE Open Medicine · doi:10.1177/2050312120901559 · Cited by 87
van Lieshout, J. V., van der Velden, J. M., Blomme, R., & Peters, P. (2021) · European Journal of Management Studies · doi:10.1108/ejms-01-2021-0007 · Cited by 77
Clinical Decision Support and Natural Language Processing in Medicine: Systematic Literature Review
Eguia, H., Sánchez-Bocanegra, C., Vinciarelli, F., Alvarez-Lopez, F., & Saigí-Rubió, F. (2024) · Journal of Medical Internet Research · doi:10.2196/55315 · Cited by 83
“The snowballing technique was used to complement the search to find the articles most relevant to the study [10].”
Time and Organizational Learning: A Review and Agenda for Future Research
Berends, H., & Antonacopoulou, E. P. (2013) · International Journal of Management Reviews · doi:10.1111/ijmr.12029 · Cited by 94
Effects of Environmental Design on Patient Outcome: A Systematic Review
Laursen, J. T., Danielsen, A. K., & Rosenberg, J. (2014) · HERD Health Environments Research & Design Journal · doi:10.1177/193758671400700410 · Cited by 87
“Furthermore, we searched the reference lists by hand of all the included studies for additional articles to be included (Greenhalgh & Peacock, 2005).”
MethodGallacher, K., Jani, B., Morrison, D., Macdonald, S., Blane, D., Erwin, P. J., May, C. R., Montori, V. M., Eton, D. T., Smith, F., et al. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-10 · Cited by 90
“Studies aimed at comprehensively summarizing the literature should include a comprehensive and rigorous database search using predefined index/subject heading/free text terms, informed by an initial scoping search [22-26].”
MethodResultInfluentialDecision-Making Around Gastrostomy-Feeding in Children With Neurologic Disabilities
Mahant, S., Jovcevska, V., & Cohen, E. (2011) · PEDIATRICS · doi:10.1542/peds.2010-3007 · Cited by 93
Integrative medicine models in contemporary primary health care
Templeman, K., & Robinson, A. (2011) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2011.02.003 · Cited by 87
Pearce, G., Pinnock, H., Epiphaniou, E., Parke, H. L., Heavey, E., Griffiths, C., Greenhalgh, T., Sheikh, A., & Taylor, S. J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0141803 · Cited by 87
“citation tracking of, and pursuing selected references from, seminal papers) may be more efficient and effective than formal database searches using exhaustive search strings [22].”
Self-citationDemena, B. A., Artavia-Mora, L., Ouedraogo, D., Thiombiano, B. A., & Wagner, N. (2020) · AIDS Patient Care and STDs · doi:10.1089/apc.2019.0181 · Cited by 102
Carmichael, R., Gross, R., Hanna, R. F., Rhodes, A., & Green, T. C. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110701 · Cited by 86
SANTIAGO, B. D. S., Scavarda, L. F., Caiado, R. G. G., Santos, R. S., & Nascimento, D. L. D. M. (2024) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.2949 · Cited by 99
Wilson, D. B. (2009) · Journal of Experimental Criminology · doi:10.1007/s11292-009-9085-5 · Cited by 86
“Greenhalgh and Peacock (2005) showed that systematic reviews of heterogeneous and complex topics are more likely to miss important empirical studies if they solely rely on bibliographic databases.”
BackgroundEffectiveness of Mindfulness-Based Therapies in Reducing Symptoms of Depression: A Meta-Analysis
McCarney, R. W., Schulz, J., & Grey, A. R. (2012) · European Journal of Psychotherapy & Counselling · doi:10.1080/13642537.2012.713186 · Cited by 85
“Additionally, ‘snowball’ methods (Greenhalgh & Peacock, 2005) were used.”
Dent, E., Visvanathan, R., Piantadosi, C., & Chapman, I. M. (2012) · Journal of Nutrition in Gerontology and Geriatrics · doi:10.1080/21551197.2012.678214 · Cited by 85
“Components of a “lateral search” ( 39 ) were also performed, including cross-referencing reference lists and tracking citations.”
Kastner, M., Hayden, L., Wong, G., Lai, Y., Makarski, J., Treister, V., Chan, J., Lee, J. H., Ivers, N. M., Holroyd-Leduc, J. M., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025009 · Cited by 89
Magnolini, R., Falcato, L., Cremonesi, A., Schori, D., & Bruggmann, P. (2022) · BMC Public Health · doi:10.1186/s12889-022-13734-4 · Cited by 85
Automatic Evidence Retrieval for Systematic Reviews
Choong, M. K., Galgani, F., Dunn, A. G., & Tsafnat, G. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3369 · Cited by 84
“Snowballing is considered best practice and is frequently recommended when conducting systematic reviews [2].”
Systematic Reviews and Librarians
McKibbon, A. (2006) · Library trends · doi:10.1353/lib.2006.0049 · Cited by 84
“Greenhalgh and Peacock (2005) showed that in 495 studies and systematic reviews of complex health care evidence, 30 percent of the data sources and articles were identifi ed using protocol-based searching methods, 24 percent came from personal knowledge or peers, and 51 percent came from…”
BackgroundJesus, T. S., Bright, F. A. S., Kayes, N. M., & Cott, C. A. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011959 · Cited by 86
“23 62 63 For related citation tracking, and to enhance the consistency and reproducibility of the approach, 52 56 we will follow the fi rst 10-related citations of each article preliminarily selected, and 10 more on each article selected thereafter.”
Fudge, N., Sadler, E., Fisher, H. R., Maher, J. F., Wolfe, C. D. A., & McKevitt, C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0160475 · Cited by 94
Arntz, F., Markov, A., Behm, D. G., Behrens, M., Negra, Y., Nakamura, M., Moran, J., & Chaabene, H. (2023) · Sports Medicine · doi:10.1007/s40279-022-01806-9 · Cited by 82
“All included studies, as well as corresponding meta-analyses, were searched for additional eligible publications in “snowball” searches [25].”
Steele, J., Bruce‐Low, S., & Smith, D. (2014) · PM&R · doi:10.1016/j.pmrj.2014.10.009 · Cited by 85
“” A “snowballing” style literature search [40] was used, involving an emergent approach as the search progressed, including searching references of references and using personal contact with authors and colleagues knowledgeable in the area.”
MethodPharmacotherapy for amphetamine dependence: A systematic review.
Lee, N., Jenner, L., Harney, A., & Cameron, J. (2018) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2018.06.038 · Cited by 70
A systematic literature review on meta sustainability labeling – What do we (not) know?
Torma, G., & Thøgersen, J. B. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.126194 · Cited by 82
Interventions to Reduce Adult Nursing Turnover: A Systematic Review of Systematic Reviews
Halter, M., Pelone, F., Boiko, O. V., Beighton, C., Harris, R. G., Gale, J., Gourlay, S., & Drennan, V. M. (2017) · The Open Nursing Journal · doi:10.2174/1874434601711010108 · Cited by 87
“We identified additional studies by searching on PubMed by using the “related citations” algorithm and screening the reference lists of included studies on for other reviews [27].”
MethodMasks and Face Coverings for the Lay Public: A Narrative Update
Czypionka, T., Greenhalgh, T., Bassler, D., & Bryant, M. B. (2021) · Annals of Internal Medicine · doi:10.7326/m20-6625 · Cited by 82
“We tracked citations of that review and other early articles through Google Scholar to locate additional studies in any language up to the end of October 2020 on the grounds that citation tracking is more effective and efficient than keyword database searching when exploring a diverse literature in which terminology i…”
MethodSelf-citationSadler, E., Wolfe, C. D. A., & McKevitt, C. (2014) · SAGE Open Medicine · doi:10.1177/2050312114544493 · Cited by 81
Oya, C., Schaefer, F., Skalidou, D., McCosker, C., & Langer, L. (2017) · Campbell Systematic Reviews · doi:10.4073/csr.2017.3 · Cited by 81
Strategic Aspects of Asset Management: An Overview of Current Research
Gavrikova, E., Volkova, I., & Burda, Y. D. (2020) · Sustainability · doi:10.3390/su12155955 · Cited by 117
Kostkova, P., Saigí-Rubió, F., Eguia, H. A., Borbolla, D. A., Verschuuren, M., Hamilton, C., Muscat, N. A., & Novillo-Ortiz, D. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.707902 · Cited by 83
“…of the following free terms and Boolean operators (AND and OR): The search was limited to English, Portuguese-, and Spanish-language publications and was complemented using the snowballing technique to identify relevant articles in the reference lists of articles returned by our search (12).”
MethodThe Role of AI in Serious Games and Gamification for Health: Scoping Review
Tolks, D., Schmidt, J., & Kühn, S. (2023) · JMIR Serious Games · doi:10.2196/48258 · Cited by 87
“RenderX method, the method of asking colleagues, as recommended by Greenhalgh and Peacock [57], was applied as a last step.”
MethodEarly correction of anterior crossbites: a systematic review
Borrie, F., & Bearn, D. (2011) · Journal of Orthodontics · doi:10.1179/14653121141443 · Cited by 82
Pre-paradigmatic status of industrial sustainability: a systematic review
Smart, P., Hemel, S., Lettice, F., Adams, R. J., & Evans, S. (2017) · International Journal of Operations & Production Management · doi:10.1108/ijopm-02-2016-0058 · Cited by 90
“…a supplementary, multi-layered strategy including hand searching, cross-referencing, snowballing and seeking out expert recommendations to pick up relevant material not included in the electronic databases (Greenhalgh and Peacock, 2005) and filtered these according to the criteria in Table II.”
MethodSadler, E., Potterton, V., Anderson, R., Khadjesari, Z., Sheehan, K. J., Butt, F., Sevdalis, N., & Sandall, J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216488 · Cited by 81
Physical workplace adjustments to support neurodivergent workers: A systematic review
Weber, C., Krieger, B., Häne, E., Yarker, J., & McDowall, A. (2024) · Applied Psychology · doi:10.1111/apps.12431 · Cited by 86
Precision of healthcare systematic review searches in a cross‐sectional sample
Sampson, M., Tetzlaff, J., & Urquhart, C. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.42 · Cited by 80
“Greenhalgh and Peacock describe such a situation with what they call complex evidence (Greenhalgh and Peacock, 2005).”
BackgroundEffectiveness of home-based pulmonary rehabilitation: systematic review and meta-analysis
Uzzaman, N., Agarwal, D. M., Chan, S. C., Engkasan, J. P., Habib, G. M., Hanafi, N. S., Jackson, T., Jebaraj, P., Khoo, E. M., Mirza, F. T., et al. (2022) · European Respiratory Review · doi:10.1183/16000617.0076-2022 · Cited by 87
A Systematic Review of Parental Self-efficacy Among Parents of School-Age Children and Adolescents
Glatz, T., Lippold, M. A., Chung, G., & Jensen, T. M. (2023) · Adolescent Research Review · doi:10.1007/s40894-023-00216-w · Cited by 126
“Checking reference lists (i.e., “snowballing” method) has shown to be efficient in finding relevant literature (e.g., Greenhalgh & Peacock, 2005; Horsley et al., 2011), with recent studies suggesting snowball techniques may capture more articles than a reliance only on systematic database searches…”
Nuzzo, J. L., Pinto, M. D., Nosaka, K., & Steele, J. (2024) · Sports Medicine · doi:10.1007/s40279-023-01937-7 · Cited by 85
“We used a mixed approach similar to that described by Greenhalgh and Peacock [20] and imple-menteded in our previous work [16].”
MethodQuality of systematic reviews in pediatric oncology – A systematic review
Lundh, A., Knijnenburg, S. L., Jørgensen, A. W., van Dalen, E. C., & Kremer, L. C. M. (2009) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2009.08.010 · Cited by 78
Bunn, F., Burn, A.-M., Goodman, C., Robinson, L., Rait, G., Norton, S., Bennett, H., Poole, M., Schoeman, J., & Brayne, C. (2016) · Health Services and Delivery Research · doi:10.3310/hsdr04080 · Cited by 72
Bellos, I., Karageorgiou, V., Pergialiotis, V., & Perrea, D. N. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.03.019 · Cited by 79
Cheng, H., McGuinness, L. A., Elbers, R. G., MacArthur, G. J., Taylor, A., McAleenan, A., Dawson, S., López-López, J. A., Higgins, J. P. T., Cowlishaw, S., et al. (2020) · BMJ · doi:10.1136/bmj.m3934 · Cited by 82
Alcohol Consumption and 15 Causes of Fatal Injuries: A Systematic Review and Meta-Analysis
Alpert, H. R., Slater, M. E., Yoon, Y.-H., Chen, C. M., Winstanley, N., & Esser, M. B. (2022) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2022.03.025 · Cited by 81
Designing Immersive Virtual Environments for Human Behavior Research
Neo, J. R. J., Won, A. S., & Shepley, M. M. (2021) · Frontiers in Virtual Reality · doi:10.3389/frvir.2021.603750 · Cited by 79
“We identi fi ed additional studies by searches of the references provided in the included publications (Greenhalgh and Peacock, 2005).”
BackgroundEberhard, K. E., Linderoth, G., Gregers, M. C. T., Lippert, F. K., & Folke, F. (2021) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-021-00875-5 · Cited by 80
Plasma and serum alpha-synuclein as a biomarker in Parkinson's disease: A meta-analysis
Zubelzu, M., Morera‐Herreras, T., Irastorza, G., Gómez‐Esteban, J. C., & Murueta‐Goyena, A. (2022) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2022.06.001 · Cited by 80
The development of hospital accreditation in low- and middle-income countries: a literature review
Mansour, W., Boyd, A., & Walshe, K. (2020) · Health Policy and Planning · doi:10.1093/heapol/czaa011 · Cited by 82
“The keyword search was supplemented with a snowballing approach until saturation was reached (Greenhalgh and Peacock, 2005).”
MethodKarasavvidis, T., Totlis, T., Gilat, R., & Cole, B. J. (2020) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2020.11.052 · Cited by 76
“In addition, the references of the included studies were retrieved and manually reviewed to identify further eligible articles, according to the snowball method.(24) Investigators were blinded to each other throughout the study selection and dataextraction processes.”
MethodPain assessment and management in surgical nursing: a literature review
Bell, L., & Duffy, A. (2009) · British Journal of Nursing · doi:10.12968/bjon.2009.18.3.39042 · Cited by 76
de Toledo, I. P., Stefani, F. M., Porporatti, A. L., Mezzomo, L. A., Peres, M. A., Flores‐Mir, C., & Canto, G. D. L. (2016) · Clinical Oral Investigations · doi:10.1007/s00784-016-1926-9 · Cited by 75
Alghababsheh, M., & Gallear, D. (2020) · Industrial Marketing Management · doi:10.1016/j.indmarman.2020.10.003 · Cited by 75
Polmann, H., Réus, J. C., Massignan, C., Serra‐Negra, J. M., Dick, B. D., Flores‐Mir, C., Lavigne, G. J., & Canto, G. D. L. (2020) · Journal of Oral Rehabilitation · doi:10.1111/joor.13142 · Cited by 81
Modelling in low-code development: a multi-vocal systematic review
Bucaioni, A., Cicchetti, A., & Ciccozzi, F. (2022) · Software & Systems Modeling · doi:10.1007/s10270-021-00964-0 · Cited by 82
“Then, we performed a closed recursive backward and forward snowballing activity [88], which helped us in minimising potential bias concerning construct validity [40].”
MethodSmith, I. C., & White, S. W. (2020) · Autism · doi:10.1177/1362361320908101 · Cited by 81
“To identify additional articles not returned in the initial search, a “snowball search” (Greenhalgh & Peacock, 2005) was conducted using Google Scholar.”
MethodMahieu, L., & Gastmans, C. (2015) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2015.07.007 · Cited by 74
Chan, C., Fage, B. A., Burton, J. K., Smailagic, N., Gill, S. S., Herrmann, N., Nikolaou, V., Quinn, T. J., Noel-Storr, A. H., & Seitz, D. P. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011414.pub2 · Cited by 71
Klonner, C., Marx, S., Usón, T. J., de Albuquerque, J. P., & Höfle, B. (2016) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi5070103 · Cited by 73
“Moreover, a backward “snowball” [33] method is used after this third step.”
BackgroundMethodInfluentialLybæk, R., Christensen, T. B., & Thomsen, T. P. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.124351 · Cited by 73
Kastner, M., Estey, E. A., Perrier, L., Graham, I. D., Grimshaw, J., Straus, S. E., Zwarenstein, M., & Bhattacharyya, O. K. (2011) · Implementation Science · doi:10.1186/1748-5908-6-69 · Cited by 72
“, reference and citation tracking) yielded the majority of relevant articles (51%) [37].”
BackgroundMethodPatient-centered Care in Maternity Services: A Critical Appraisal and Synthesis of the Literature
de Labrusse, C., Ramelet, A., Humphrey, T., & MacLennan, S. J. (2015) · Women s Health Issues · doi:10.1016/j.whi.2015.09.003 · Cited by 73
Wong, G., Brennan, N., Mattick, K. L., Pearson, M., Briscoe, S., & Papoutsi, C. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009059 · Cited by 72
“More exploratory and informal search methods, such as citation tracking and snow-balling, 34 along with more structured searching for theories 35 will be used.”
MethodSansoni, J., Duncan, C., Grootemaat, P. E., Capell, J. T., Samsa, P., & Westera, A. (2016) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/1533317515619481 · Cited by 79
Elkins, M. R., Herbert, R., Moseley, A. M., Sherrington, C., & Maher, C. G. (2010) · Cardiopulmonary Physical Therapy Journal · doi:10.1097/01823246-201021030-00005 · Cited by 72
The state of health advocacy training in postgraduate medical education: a scoping review
McDonald, M., Lavelle, C., Wen, M., Sherbino, J., & Hulme, J. (2019) · Medical Education · doi:10.1111/medu.13929 · Cited by 69
Bellos, I., Daskalakis, G., & Pergialiotis, V. (2020) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkaa184 · Cited by 73
What does the literature mean by social prescribing? A critical review using discourse analysis
Calderón‐Larrañaga, S., Greenhalgh, T., Finer, S., & Clinch, M. (2022) · Sociology of Health & Illness · doi:10.1111/1467-9566.13468 · Cited by 73
Self-citationEffectiveness of conceptual change strategies in science education: A meta‐analysis
Paçacı, Ç., Üstün, U., & Özdemir, Ö. F. (2023) · Journal of Research in Science Teaching · doi:10.1002/tea.21887 · Cited by 111
Hollands, G. J., Shemilt, I., Marteau, T. M., Jebb, S. A., Kelly, M. P., Nakamura, R., Suhrcke, M., & Ogilvie, D. (2013) · Cited by 68
Transforming Health Care One Team at a Time: Ten Observations and the Trail Ahead
Salas, E., Zajac, S. A., & Marlow, S. L. (2018) · Group & Organization Management · doi:10.1177/1059601118756554 · Cited by 76
“Relevant review articles were identified, and backward and forward snowball techniques (i.e., the reference lists of these articles were searched; Greenhalgh & Peacock, 2005) were used to obtain an overview of existing evidence as well as the most up-to-date primary studies.”
MethodMessage framing strategies for effective marine conservation communication
Kolandai‐Matchett, K., & Armoudian, M. (2020) · Aquatic Conservation Marine and Freshwater Ecosystems · doi:10.1002/aqc.3349 · Cited by 79
Metadata
- Authors
- Greenhalgh, T., & Peacock, R.
- Affiliations
- University College London (GB)
- Corresponding author
- Greenhalgh, Trisha
- ORCID
- Greenhalgh, Trisha
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2005-10-17
- Volume
- 331
- Issue
- 7524
- Pages
- 1064-1065
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- PMC
- PMC1283190
- OpenAlex
- W2149364707
- Semantic Scholar
- 45cd85a4c05c0c295e4569e08f20a6f3268e6390
- Cited by
- 2,045
- References
- 5
- Citations by year
- 2026: 162 · 2025: 147 · 2024: 202 · 2023: 188 · 2022: 187 · 2021: 210 · 2020: 157 · 2019: 139 · 2018: 88 · 2017: 92 · 2016: 77 · 2015: 74 · 2014: 83 · 2013: 69 · 2012: 41
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- systematic reviews, snowballing, protocol adherence, database searching, hand searching
- MeSH terms
- Data Collection, Review Literature as Topic, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
