The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada
Open accessAbstract
BACKGROUND: Grey literature is an important source of information for large-scale review syntheses. However, there are many characteristics of grey literature that make it difficult to search systematically. Further, there is no 'gold standard' for rigorous systematic grey literature search methods and few resources on how to conduct this type of search. This paper describes systematic review search methods that were developed and applied to complete a case study systematic review of grey literature that examined guidelines for school-based breakfast programs in Canada. METHODS: A grey literature search plan was developed to incorporate four different searching strategies: (1) grey literature databases, (2) customized Google search engines, (3) targeted websites, and (4) consultation with contact experts. These complementary strategies were used to minimize the risk of omitting relevant sources. Since abstracts are often unavailable in grey literature documents, items' abstracts, executive summaries, or table of contents (whichever was available) were screened. Screening of publications' full-text followed. Data were extracted on the organization, year published, who they were developed by, intended audience, goal/objectives of document, sources of evidence/resources cited, meals mentioned in the guidelines, and recommendations for program delivery. RESULTS: The search strategies for identifying and screening publications for inclusion in the case study review was found to be manageable, comprehensive, and intuitive when applied in practice. The four search strategies of the grey literature search plan yielded 302 potentially relevant items for screening. Following the screening process, 15 publications that met all eligibility criteria remained and were included in the case study systematic review. The high-level findings of the case study systematic review are briefly described. CONCLUSIONS: This article demonstrated a feasible and seemingly robust method for applying systematic search strategies to identify web-based resources in the grey literature. The search strategy we developed and tested is amenable to adaptation to identify other types of grey literature from other disciplines and answering a wide range of research questions. This method should be further adapted and tested in future research syntheses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Godin et al. [17] use a bookmarking system within their web browser to avoid identifying the same record twice as the URL of previously bookmarked pages are starred.”
From Exploring issues in the conduct of website searching and other online sources for systematic reviews: how can we be systematic? (2016) · cites this paper as [17]
In the citing paper
“In contrast, Godin et al. [17] describe a different approach where they searched a website database or used the search function and hand-searched where these functions were not available.”
From Exploring issues in the conduct of website searching and other online sources for systematic reviews: how can we be systematic? (2016) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Rampersaud, G. C., Pereira, M. A., Girard, B. L., Adams, J., & Metzl, J. D. (2005) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2005.02.007 · Cited by 1,333
Finding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 942
Searching for grey literature for systematic reviews: challenges and benefits
Mahood, Q., Van Eerd, D., & Irvin, E. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1106 · Cited by 814
Grey literature in meta-analyses of randomized trials of health care interventions
Hopewell, S., McDonald, S., Clarke, M. J., & Egger, M. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000010.pub3 · Cited by 598 · cited 1×
“For reviews of intervention studies, failure to include grey literature may artificially amplify estimates of treatment effects, given the effects of publication bias [5].”
BackgroundSystematic Reviews: Constructing a Search Strategy and Searching for Evidence
Aromataris, E., & Riitano, D. (2014) · AJN, American Journal of Nursing · doi:10.1097/01.naj.0000446779.99522.f6 · Cited by 523
Research works printed but not linked: 28
- Farace DJ, Frantzen J, editors. Sixth international conference on grey literature: work on grey in progress. grey literature 2004 conference proceedings; Dec. 6–7, 2004. Amsterdam: TextRelease; 2005.
- Toronto District School Board. Feeding our future: the first- and second-year evaluation. 2012.
- Ontario Public Health Libraries Association. Custom search engine for Canadian public health information. 2015. http://www.ophla.ca/customsearchcanada.htm . Accessed Jul 29 2015.
- MADGIC CU. Search for government publications in primo and google custom search. 2015. http://subjectguides.uwaterloo.ca/content.php?pid=408339 . Accessed Jul 29 2015.
- Information services CADTH. Grey matters: a practical search tool for evidence-based medicine. Ottawa: Canadian Agency for Drugs and Technologies in Health; 2014. https://www.cadth.ca/resources/finding-evidence/grey-matters-practical-search-tool-evidence-based-medicine . Accessed September 11 2015.
- Government of Manitoba. Moving forward with school nutrition guidelines. 2014.
- Newfoundland and Labrador Department of Education & Department of Health and Community Services. Healthy eating school resources manual. 2006.
- Nova Scotia Department of Education. Provincial breakfast program standards. 2007.
- Ontario Ministry of Children & Youth Services. Student nutrition program nutrition guidelines. 2008.
- Ontario Ministry of Children & Youth Services. Ontario’s student nutrition program guidelines. 2014.
- Child Nutrition Council of Manitoba. Fact sheets and best practices. 2015. http://childnutritioncouncil.com/resources/best-practices-fact-sheets-and-info/ . Accessed June 1 2015.
- Saskatchewan School Boards Association. Nutrition guidelines for schools. 2009.
- Breakfast for Learning. Breakfast for learning start-up kit. 2014.
- Breakfast Club of Canada. Build them up! Guide. 2015.
- Nourish Nova Scotia. Nourish Nova Scotia program resources. 2015. https://nourishns.ca/program-resources . Accessed May 28 2015.
- Cancer Care Ontario. Healthy eating guidelines for school nutrition programs: a resource for first nations schools. 2012. https://www.cancercare.on.ca/cms/one.aspx?objectId=9329&contextId=1377 . Accessed May 28 2015.
- Ontario Society of Nutrition Professionals in Public Health. Nutrition tools for schools: student nutrition programs. 2013. http://nutritiontoolsforschools.ca/guide/student-nutrition-programs . Accessed May 28 2015.
- Alberta Health Services. Breakfast program resource. 2009.
- British Columbia Ministry of Education, Ministry of Healthy Living and Sport. School meal and school nutrition program handbook. 2010.
- D’Alessandro M. SearchingRadiology.com. 2015. http://www.searchingradiology.com/ . Accessed Jul 29 2015.
- Google. Custom search engine. 2015. https://cse.google.ca/cse/ . Accessed Jul 29 2015.
- The Coalition for Healthy School Food. The coalition for healthy school food. 2015. http://foodsecurecanada.org/CHSF . Accessed Jun 11 2015.
- Bronson D. Presentation to the standing committee on finance. 2012.
- Centre for Science in the Public Interest. A national nutritious school meal program for Canadian children. 2009.
- Howard A, Edge J. Enough for all: household food security in Canada. 2013.
- Nunavut Food Security Coalition. Nunavut food security strategy and action plan 2014–6. 2014.
- Statistics Canada. Population by sex and age group, by province and territory. 2014. http://www.statcan.gc.ca/tables-tableaux/sum-som/l01/cst01/demo31d-eng.htm . Accessed June 14 2015.
- The Healthy Kids Panel. No time to wait: the healthy kids strategy. 2013. http://www.health.gov.on.ca/en/common/ministry/publications/reports/healthy_kids/healthy_kids.aspx . Accessed Jun 11 2015.
Cited by
Environmental education outcomes for conservation: A systematic review
Ardoin, N. M., Bowers, A. W., & Gaillard, E. (2020) · Biological Conservation · doi:10.1016/j.biocon.2019.108224 · Cited by 924
Garousi, V., Felderer, M., & Mäntylä, M. V. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.09.006 · Cited by 831
Adams, J., Hillier-Brown, F. C., Moore, H. J., Lake, A. A., Araujo-Soares, V., White, M., & Summerbell, C. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0337-y · Cited by 486
Artificial intelligence for good health: a scoping review of the ethics literature.
Murphy, K., Di Ruggiero, E., Upshur, R., Willison, D. J., Malhotra, N., Cai, J. C., Malhotra, N., Lui, V., & Gibson, J. (2021) · BMC Medical Ethics · doi:10.1186/s12910-021-00577-8 · Cited by 435
Trends in the regulation of per- and polyfluoroalkyl substances (PFAS): a scoping review
Brennan, N. M., Evans, A. T., Fritz, M. K., Peak, S. A., & von Holst, H. E. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182010900 · Cited by 422
Metadata
- Authors
- Godin, K., Stapleton, J., Kirkpatrick, S. I., Hanning, R. M., & Leatherdale, S. T.
- Affiliations
- University of Waterloo (CA)
- Corresponding author
- Godin, Katelyn
- Venue
- Systematic Reviews
- Published
- 2015-10-22
- Volume
- 4
- Issue
- 1
- Pages
- 138-138
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC4619264
- OpenAlex
- W2131361607
- Cited by
- 959
- References
- 28
- Citations by year
- 2026: 131 · 2025: 134 · 2024: 175 · 2023: 120 · 2022: 122 · 2021: 116 · 2020: 57 · 2019: 43 · 2018: 35 · 2017: 19 · 2016: 5
- FWCI
- 3.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UWSpace (University of Waterloo) (submittedVersion, cc-by-nc-nd)
- Funders
- Canadian Institutes of Health Research (CA) (53893)
- Canadian Cancer Society Research Institute (CA) (702855)
- Public Health Agency of Canada/Canadian Institutes of Health Research (ᅟ)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Optics and Image Analysis
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- grey literature, systematic review search strategy, online resources, Google search, expert consultation, Canada
- MeSH terms
- Abstracting and Indexing, Systematic Reviews as Topic, Canada, Humans, Schools, Databases, Bibliographic, Information Storage and Retrieval, Guidelines as Topic, Internet, Search Engine, Breakfast
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada. https://app.cochat.ai/papers/10.1186/s13643-015-0125-0
- The paper
- Godin, K., Stapleton, J., Kirkpatrick, S. I., Hanning, R. M., & Leatherdale, S. T. (2015). Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada. Systematic Reviews. https://doi.org/10.1186/s13643-015-0125-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.