The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
A rapid method to increase transparency and efficiency in web-based searches
Open accessAbstract
Many online search facilities allow searching for academic literature. The majority are bibliographic databases that catalogue published research in an iterative, semi-automated manner, e.g. Web of Science Core Collections, which indexes articles published in selected journals. Other resources, such as Google Scholar, identify academic articles by using search engines that crawl the internet for potentially relevant information. Often, systematic reviewers wish to document their searches for transparency or later screening. Indeed, such transparency is a cornerstone of systematic review methodology. Whilst bibliographic databases typically allow users to extract search results as citations in bulk, several other key resources, such as Google Scholar and organisation websites, do not allow this: citations must be extracted individually, which is often prohibitively time consuming. Here, we describe novel methods for downloading results from searches of websites and web-based search engines into comprehensive databases as citations using free-to-use software. Citations from web-based search engines can then be integrated into review procedures along with those from traditional online bibliographic databases. These methods substantially increase transparency and repeatability when searching online resources. They may also significantly reduce resource requirements for such searches and therefore represent a significant increase in efficiency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Locating scientific articles by keyword-based searching is particularly inefficient because it returns a large amount of irrelevant information 27”
From Software support for environmental evidence synthesis (2018) · cites this paper as [27]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · cited 1×
“When synthesising evidence in a systematic review it is vital that processes are documented transparently to ensure a high level of repeatability [5, 6].”
BackgroundPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses
Falagas, M. E., Pitsouni, E. I., Malietzis, G. A., & Pappas, G. (2008) · The FASEB Journal · doi:10.1096/fj.07-9492lsf · Cited by 5,039 · cited 1×
“com/faq-webof-science), meaning individual bibliographic databases are less comprehensive than resources such as Google Scholar [4].”
BackgroundThe role of google scholar in evidence reviews and its applicability to grey literature searching
Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138237 · Cited by 2,387
Self-citationReducing and meta-analysing estimates from distributed lag non-linear models
Gasparrini, A., & Armstrong, B. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-1 · Cited by 1,081
How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-4-200708210-00179 · Cited by 838
Trevena, L. J., Zikmund-Fisher, B. J., Edwards, A., Gaissmaier, W., Galesic, M., Han, P. K., King, J., Lawson, M. L., Linder, S. K., Lipkus, I., et al. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-s2-s7 · Cited by 538
How does tillage intensity affect soil organic carbon? A systematic review
Haddaway, N. R., Hedlund, K., Jackson, L. E., Kätterer, T., Lugato, E., Thomsen, I. K., Jørgensen, H. B., & Isberg, P.-E. (2017) · Environmental Evidence · doi:10.1186/s13750-017-0108-9 · Cited by 485
Self-citationMaking literature reviews more reliable through application of lessons from systematic reviews
Haddaway, N. R., Woodcock, P., Macura, B., & Collins, A. (2015) · Conservation Biology · doi:10.1111/cobi.12541 · Cited by 416 · cited 1×
“Transparency can likewise improve the rigour and credibility of other review methods that involve searches for information, such as traditional literature reviews and meta-analyses, demonstrating that an unbiased approach to the collation of information has been used [7].”
BackgroundSelf-citation
Research works printed but not linked: 1
- CEE. Guidelines for systematic review and evidence synthesis in environmental management. Bangor: The Collaboration for Environmental Evidence. 2013.
Cited by
Soil carbon sequestration by root exudates
Panchal, P., Preece, C., Peñuelas, J., & Giri, J. (2022) · Trends in Plant Science · doi:10.1016/j.tplants.2022.04.009 · Cited by 451
Ogle, S. M., Alsaker, C., Baldock, J., Bernoux, M., Breidt, F. J., McConkey, B., Regina, K., & Vazquez-Amabile, G. G. (2019) · Scientific Reports · doi:10.1038/s41598-019-47861-7 · Cited by 324
Research Weaving: Visualizing the Future of Research Synthesis
Nakagawa, S., Samarasinghe, G., Haddaway, N. R., Westgate, M. J., O’Dea, R. E., Noble, D. W. A., & Lagisz, M. (2019) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2018.11.007 · Cited by 261
Self-citationGlobal variation in soil carbon sequestration potential through improved cropland management
Lessmann, M., Ros, G. H., Young, M. D., & de Vries, W. (2022) · Global Change Biology · doi:10.1111/gcb.15954 · Cited by 257
The current status, challenges and prospects of using biomass energy in Ethiopia
Benti, N. E., Gurmesa, G. S., Argaw, T., Aneseyee, A. B., Gunta, S., Kassahun, G. B., Aga, G. S., & Asfaw, A. A. (2021) · Biotechnology for Biofuels · doi:10.1186/s13068-021-02060-3 · Cited by 218
Metadata
- Authors
- Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S.
- Affiliations
- Stockholm Environment Institute (SE)
- Department for Environment Food and Rural Affairs (GB)
- Corresponding author
- Haddaway, Neal R.
- Venue
- Environmental Evidence
- Published
- 2017-01-03
- Volume
- 6
- Issue
- 1
- ISSN
- 2047-2382 (ISSN-L)
- OpenAlex
- W2561629699
- Cited by
- 129
- References
- 28
- Citations by year
- 2026: 5 · 2025: 25 · 2024: 21 · 2023: 17 · 2022: 12 · 2021: 17 · 2020: 9 · 2019: 10 · 2018: 7 · 2017: 6
- FWCI
- 7.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Environmental Evidence (publishedVersion, cc-by)
- Funders
- Bangor University
- Natural Environment Research Council (NE/L011506/1)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- systematic review search strategy, citation export, Google Scholar, web-based search engine, search efficiency, reference management software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A rapid method to increase transparency and efficiency in web-based searches. https://app.cochat.ai/papers/10.1186/s13750-016-0079-2
- The paper
- Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S. (2017). A rapid method to increase transparency and efficiency in web-based searches. Environmental Evidence. https://doi.org/10.1186/s13750-016-0079-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.