‘Clustering’ documents automatically to support scoping reviews of research: a case study
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Background: Scoping reviews of research help determine the feasibility and the resource requirements of conducting a systematic review, and the potential to generate a description of the literature quickly is attractive. Aims: To test the utility and applicability of an automated clustering tool to describe and group research studies to improve the efficiency of scoping reviews. Methods: A retrospective study of two completed scoping reviews was conducted. This compared the groups and descriptive categories obtained by automatically clustering titles and abstracts with those that had originally been derived using traditional researcher‐driven techniques. Results: The clustering tool rapidly categorised research into themes, which were useful in some instances, but not in others. This provided a dynamic means to view each dataset. Interpretation was challenging where there were potentially multiple meanings of terms. Where relevant clusters were unambiguous, there was a high precision of relevant studies, although recall varied widely. Conclusions: Policy‐relevant scoping reviews are often undertaken rapidly, and this could potentially be enhanced by automation depending on the nature of the dataset and information sought. However, it is not a replacement for researcher‐developed classification. The possibilities of further applications and potential for use in other types of review are discussed. Copyright © 2013 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063
Self-citationApplications of text mining within systematic reviews
Thomas, J., McNaught, J., & Ananiadou, S. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.27 · Cited by 212
Self-citation
Cited by
Cooper, C., Booth, A., Varley-Campbell, J., Britten, N., & Garside, R. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0545-3 · Cited by 561
Artificial intelligence to automate the systematic review of scientific literature
de la Torre-López, J., Ramírez, A., & Romero, J. R. (2023) · Computing · doi:10.1007/s00607-023-01181-x · Cited by 170
“At the beginning of the planning phase, it is recommended to perform a preliminary analysis of the scope and magnitude of the SLR [22].”
MethodMachine learning techniques for the automation of literature reviews and systematic reviews in EFSA
Jaspers, S., De Troyer, E., & Aerts, M. (2018) · EFSA Supporting Publications · doi:10.2903/sp.efsa.2018.en-1427 · Cited by 36
“Some more advanced methods, which incorporate also tables and figures, are presented by Thomas et al. (2011) and by Rodriguez- Esteban and Iossifov (2009). In step 10 of the SR process, the researcher should follow the citations of the selected, relevant trials to find some additional sources of information that can b…”
MethodMuller, A. E., Ames, H. M. R., Jardim, P. S. J., & Rose, C. J. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1541 · Cited by 21
“In the context of systematic reviewing, an automated text clustering system “ analyses the distribution of terms (words) in a body of text (e.g., titles and abstracts) and identifies groups of documents that use similar combinations of words; clustering ‘ engines ’ often then apply a descriptive term to each cluster t…”
BackgroundMethodInfluential
Metadata
- Authors
- Stansfield, C., Thomas, J., & Kavanagh, J.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2013-07-03
- Volume
- 4
- Issue
- 3
- Pages
- 230-241
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W1542270450
- Cited by
- 20
- References
- 2
- FWCI
- 0.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ‘Clustering’ documents automatically to support scoping reviews of research: a case study. https://app.cochat.ai/papers/10.1002/jrsm.1082
- The paper
- Stansfield, C., Thomas, J., & Kavanagh, J. (2013). ‘Clustering’ documents automatically to support scoping reviews of research: a case study. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1082
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.