Using bibliographic software to appraise and code data in educational systematic review research
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Bibliographic database software is often recommended as a tool that can assist researchers in managing the large numbers of references produced in early stages of a systematic review. The uses of such software in systematic review research are often represented solely in terms of bibliographic functions, while the uses that extend beyond simple bibliographic functions have not been explored. AIMS: This article provides a guide on how to use extended functions of bibliographic software to systematically complete the steps of appraising search results and coding references for inclusion in or exclusion from the systematic review. METHODS: The process is illustrated using an ongoing systematic review as a case description and using screenshots from the bibliographic database, EndNote®, the authors' preferred software program for the study. RESULTS: The case description illustrates how bibliographic software serves not only to organize and store search results, but also to appraise and code search results and to explicitly track researchers' decisions across the systematic review. CONCLUSION: Bibliographic tools can contribute to make the methods that researchers adopt for the phase following the initial literature search more transparent and systematic. The illustrative case description involves a systematic review of academic education in occupational therapy, but easily generalizes to systematic reviews in other health science professions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Dornan, T., Littlewood, S., Margolis, S. A., Scherpbier, A., Spencer, J., & Ypinazar, V. (2006) · Medical Teacher · doi:10.1080/01421590500410971 · Cited by 501
Conducting a best evidence systematic review. Part 1: From idea to data coding. BEME Guide No. 13
Hammick, M., Dornan, T., & Steinert, Y. (2010) · Medical Teacher · doi:10.3109/01421590903414245 · Cited by 230 · cited 4×
“As a result, scholars have called for transparency, rigor, and quality control during this phase of the systematic review (Reeves et al. 2002; Hammick et al. 2010).”
BackgroundMethodInfluentialTwelve tips for undertaking a systematic review
Reeves, S., Koppel, I., Barr, H., Freeth, D., & Hammick, M. (2002) · Medical Teacher · doi:10.1080/01421590220145707 · Cited by 64 · cited 2×
“As a result, scholars have called for transparency, rigor, and quality control during this phase of the systematic review (Reeves et al. 2002; Hammick et al. 2010).”
BackgroundMethod
Cited by
Mendes, K. D. S., Silveira, R. C. D. C. P., & Galvão, C. M. (2019) · Texto & Contexto - Enfermagem · doi:10.1590/1980-265x-tce-2017-0204 · Cited by 548
Facilitating systematic reviews, data extraction and meta‐analysis with the metagear package for r
Lajeunesse, M. J. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12472 · Cited by 341
“Reference-managing software such as Endnote or Mendeley can be shoehorned for this purpose (see King et al. 2011).”
MethodReviewing retrieved references for inclusion in systematic reviews using EndNote
Bramer, W. M., Milic, J., & Mast, F. (2017) · Journal of the Medical Library Association · doi:10.5195/jmla.2017.111 · Cited by 264
“[3], but this process is rather complicated”
Conducting systematic reviews in medical education: a stepwise approach
Cook, D. A., & West, C. P. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04328.x · Cited by 186
Managing and Coding References for Systematic Reviews and Scoping Reviews in EndNote
Peters, M. D. J. (2017) · Medical Reference Services Quarterly · doi:10.1080/02763869.2017.1259891 · Cited by 117
Metadata
- Authors
- King, R., Hooper, B., & Wood, W.
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2011-08-19
- Volume
- 33
- Issue
- 9
- Pages
- 719-723
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2144221262
- Cited by
- 48
- References
- 4
- FWCI
- 0.92
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using bibliographic software to appraise and code data in educational systematic review research. https://app.cochat.ai/papers/10.3109/0142159x.2011.558138
- The paper
- King, R., Hooper, B., & Wood, W. (2011). Using bibliographic software to appraise and code data in educational systematic review research. Medical Teacher. https://doi.org/10.3109/0142159x.2011.558138
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.