The selection of search sources influences the findings of a systematic review of people’s views: a case study in public health
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
BACKGROUND: For systematic reviews providing evidence for policy decisions in specific geographical regions, there is a need to minimise regional bias when seeking out relevant research studies. Studies on people's views tend to be dispersed across a range of bibliographic databases and other search sources. It is recognised that a comprehensive literature search can provide unique evidence not found from a focused search; however, the geographical focus of databases as a potential source of bias on the findings of a research review is less clear. This case study describes search source selection for research about people's views and how supplementary searches designed to redress geographical bias influenced the findings of a systematic review. Our research questions are: a) what was the impact of search methods employed to redress potential database selection bias on the overall findings of the review? and b) how did each search source contribute to the identification of all the research studies included in the review? METHODS: The contribution of 25 search sources in locating 28 studies included within a systematic review on UK children's views of body size, shape and weight was analysed retrospectively. The impact of utilising seven search sources chosen to identify UK-based literature on the review's findings was assessed. RESULTS: Over a sixth (5 out of 28) of the studies were located only through supplementary searches of three sources. These five studies were of a disproportionally high quality compared with the other studies in the review. The retrieval of these studies added direction, detail and strength to the overall findings of the review. All studies in the review were located within 21 search sources. Precision for 21 sources ranged from 0.21% to 1.64%. CONCLUSIONS: For reducing geographical bias and increasing the coverage and context-specificity of systematic reviews of people's perspectives and experiences, searching that is sensitive and aimed at reducing geographical bias in database sources is recommended.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Self-citationEgger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Dissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039 · cited 1×
“[7] classify a range of biases associated with publishing and identifying research in reviews of health care effectiveness and related areas.”
BackgroundHarden, A., Garcia, J., Oliver, S., Rees, R., Shepherd, J., Brunton, G., & Oakley, A. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.014829 · Cited by 328 · cited 3×
“6 analysis; and whether findings appeared grounded in or supported by data); and ii) the usefulness of study findings (based upon the breadth and depth of findings as well as whether there was evidence of attention by researchers to an ideal of privileging young people’s views [1,14].”
BackgroundInfluentialSelf-citationPapaioannou, D., Sutton, A., Carroll, C., Booth, A., & Wong, R. (2010) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00863.x · Cited by 318
The Challenges of Searching for and Retrieving Qualitative Studies
Barroso, J., Gollop, C. J., Sandelowski, M., Meynell, J., Pearce, P. F., & Collins, L. J. (2003) · Western Journal of Nursing Research · doi:10.1177/0193945902250034 · Cited by 272 · cited 1×
“Furthermore, there is large variation in the terminology used to describe research methods and in the database indexing of relevant literature [2-4].”
Method
Cited by
“Best fit” framework synthesis: refining the method
Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-37 · Cited by 649
“More recent research suggests that the Social Sciences Citation Index represents either an additional potential source in this search or a potential substitute for CINAHL [20].”
BackgroundInfluentialBooth, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0249-x · Cited by 569
Harris, J. L., Booth, A., Cargo, M., Hannes, K., Harden, A., Flemming, K., Garside, R., Pantoja, T., Thomas, J., & Noyes, J. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.023 · Cited by 165
Self-citationThomas, J. (2013) · OA Evidence-Based Medicine · doi:10.13172/2053-2636-1-2-1109 · Cited by 44
Self-citationBeyer, F. R., & Wright, K. (2013) · Health Information & Libraries Journal · doi:10.1111/hir.12009 · Cited by 47
Metadata
- Authors
- Stansfield, C., Kavanagh, J., Rees, R., Gomersall, A., & Thomas, J.
- Venue
- BMC Medical Research Methodology
- Published
- 2012-04-20
- Volume
- 12
- Issue
- 1
- Pages
- 55-55
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W1988790080
- Cited by
- 36
- References
- 6
- FWCI
- 1.42
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The selection of search sources influences the findings of a systematic review of people’s views: a case study in public health. https://app.cochat.ai/papers/10.1186/1471-2288-12-55
- The paper
- Stansfield, C., Kavanagh, J., Rees, R., Gomersall, A., & Thomas, J. (2012). The selection of search sources influences the findings of a systematic review of people’s views: a case study in public health. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-12-55
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.