The DOI matches its Crossref record; 26 of the 29 references it cites were found in a registry or an index; 2 of the 3 sources its claims cite were checked for support.
Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry
Open accessAbstract
OBJECTIVES: To summarise logistical aspects of recently completed systematic reviews that were registered in the International Prospective Register of Systematic Reviews (PROSPERO) registry to quantify the time and resources required to complete such projects. DESIGN: Meta-analysis. DATA SOURCES AND STUDY SELECTION: All of the 195 registered and completed reviews (status from the PROSPERO registry) with associated publications at the time of our search (1 July 2014). DATA EXTRACTION: All authors extracted data using registry entries and publication information related to the data sources used, the number of initially retrieved citations, the final number of included studies, the time between registration date to publication date and number of authors involved for completion of each publication. Information related to funding and geographical location was also recorded when reported. RESULTS: The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42). The number of studies found in the literature searches ranged from 27 to 92 020; the mean yield rate of included studies was 2.94% (IQR=2.5); and the mean number of authors per review was 5, SD=3. Funded reviews took significantly longer to complete and publish (mean=42 vs 26 weeks) and involved more authors and team members (mean=6.8 vs 4.8 people) than those that did not report funding (both p<0.001). CONCLUSIONS: Systematic reviews presently take much time and require large amounts of human resources. In the light of the ever-increasing volume of published studies, application of existing computing and informatics technology should be applied to decrease this time and resource burden. We discuss recently published guidelines that provide a framework to make finding and accessing relevant literature less burdensome.
Overview
CoChat Summary
## TL;DR
Using 195 completed PROSPERO-registered systematic reviews of medical interventions, the authors estimated that reviews took a mean of 67.3 weeks to complete and publish and involved a mean of 5 authors per review. They conclude that systematic reviews are time- and labor-intensive, with funded reviews taking longer and involving more people than unfunded reviews.
## Key findings
- Across 195 completed reviews, the mean estimated time from registered project start to publication was 67.3 weeks (SD=31.0; range 6–186 weeks).
- The mean number of authors/team members was 5 (SD=3), and the mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).
- Literature searches were highly variable, with the number of studies found ranging from 27 to 92,020.
- Reviews that reported funding took longer and involved more people than those that did not report funding: 42 vs 26 weeks and 6.8 vs 4.8 people, both p<0.001.
## Methods
- Meta-analysis of PROSPERO registry records linked to completed review publications, using a sample of 195 registered and completed reviews with associated publications identified on 1 July 2014.
- Data were extracted from registry entries and publications on timing, authors/team members, funding, search sources, initial citations, and final included studies; the sample comprised 197 literature reviews from the 195 publications.
- Main analyses were descriptive summaries of means, ranges, and yield rates, plus ANOVA to compare funded vs unfunded reviews.
## Limitations
- The paper states that the study is limited by incomplete reporting in both the registry and the published articles, and that registry and publication data were cross-checked only where available.
- The authors state that the true project start date was difficult to capture, so their time estimates may be conservative and may underestimate time from the very first review activities.
- The paper notes that the data are highly skewed, making prediction of timelines statistically unsound; this is an evident limitation of the analysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
1 Valid · 1 Not valid · 1 Not checked · 23 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean number of authors per review was 5, SD=3.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42).”
- Also stated in: § Results · plain
“The mean project length (using the registered project start date to the review's publication date) was 67.3 weeks (SD=31.0; range 6–186 weeks).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean yield rate of included studies was 2.94% (IQR=2.5);”
- Also stated in: § Results · plain
“The mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plainn = 190- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reviews that reported funding took longer to complete and included more authors/team members; this difference was not seen when we considered only whether specific authors were funded.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of studies found in the literature searches ranged from 27 to 92 020;”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
9 more claims
Create a free account to see all 26 claims and every source verdict.
- Probably not a substantial claim. 11
- It may state two separate claims as one. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Typically, only a small fraction of the records belong to the relevant class, making title and abstract screening an important bottleneck in systematic reviewing process 25 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“requiring a median of five researchers and around 40 weeks of work to reach submission [ 3 , 4 ]”
From Reducing systematic review burden using Deduklick: a novel, automated, reliable, and explainable deduplication algorithm to foster medical research (2022) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“typically taking over 16 months and costing upwards of $100,000 to complete 1,2 .”
From Automation of Systematic Reviews with Large Language Models (2025) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLMs can automate critical tasks for SLRs, including screening abstracts and full texts, assessing risk of bias and extracting data for use in network meta-analyses with high accuracy, all while significantly reducing the time and costs required by using human review [2, 4–7].”
From Automated Mass Extraction of Over 680,000 PICOs from Clinical Study Abstracts Using Generative AI: A Proof-of-Concept Study. (2024) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The HTA process is very labour and resource intensive, requiring a large team of experts in the field of health economic outcomes research (HEOR), including SLR analysts, statisticians and economic modellers [5, 8].”
From Artificial Intelligence to Automate Network Meta-Analyses: Four Case Studies to Evaluate the Potential Application of Large Language Models (2024) · cites this paper as [8]
Experimental — accuracy not yet measured
18 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 3×
“…clinical trials could be a starting point for testing the use of indexing systems that employ a Population, Intervention, Comparisons, Outcomes, Study Design (PICOS) 15 structure of coding metadata for clinical trials in order to make the scienti fi c literature become a truly searchable database.”
BackgroundInfluentialThe FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“1 Since the body of primary literature has increased, conducting systematic reviews and meta-analyses has become a necessity to more accurately and comprehensively present accumulated knowledge to scienti fi c, clinical and general audiences.”
BackgroundPROSPERO: an international prospective register of systematic reviews
Wright, K. E. (2014) · Cited by 568
(1965) · Nature · doi:10.1038/205236a0 · Cited by 560
Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram
Stovold, E., Beecher, D., Foxlee, R., & Noel-Storr, A. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-54 · Cited by 356
Cited by
An open source machine learning framework for efficient and transparent systematic reviews
van de Schoot, R., de Bruin, J., Schram, R., Zahedi, P., de Boer, J., Weijdema, F., Kramer, B., Huijts, M., Hoogerwerf, M., Ferdinands, G., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-020-00287-7 · Cited by 1,157
Munn, Z., Aromataris, E., Tufanaru, C., Stern, C., Porritt, K., Farrow, J., Lockwood, C., Stephenson, M., Moola, S., Lizarondo, L., et al. (2019) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000152 · Cited by 977
Belur, J., Tompson, L., Thornton, A., & Simon, M. (2021) · Sociological Methods & Research · doi:10.1177/0049124118799372 · Cited by 753
“A recent study (Borah et al. 2017) on the resources required to conduct systematic reviews indicated that the mean number of members involved in conducting a systematic review was 5 (SD 1⁄4 3) and the average time period required to conduct and publish a review was 67.”
BackgroundInfluentialA full systematic review was completed in 2 weeks using automation tools: a case study
Clark, J., Glasziou, P., Del Mar, C., Bannach-Brown, A., Stehlik, P., & Scott, A. M. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.008 · Cited by 687
Marshall, I. J., & Wallace, B. C. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1074-9 · Cited by 638
Metadata
- Authors
- Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A.
- Affiliations
- University of Alabama at Birmingham (US)
- Corresponding author
- Kaiser, Kathryn A
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-02
- Volume
- 7
- Issue
- 2
- Pages
- e012545
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5337708
- OpenAlex
- W2593758073
- Cited by
- 737
- References
- 29
- Citations by year
- 2026: 114 · 2025: 129 · 2024: 105 · 2023: 76 · 2022: 71 · 2021: 80 · 2020: 87 · 2019: 42 · 2018: 24 · 2017: 9
- FWCI
- 10.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- IUScholarWorks Open (Indiana University) (submittedVersion, cc-by-nc)
- HighWire Press Open Archive (submittedVersion)
- Funders
- University of Alabama at Birmingham (P30DK056336)
- University of Alabama (P30DK056336)
- National Institutes of Health
- National Institute of General Medical Sciences (K12GM088010)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK056336)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- systematic reviews, time to publication, research workforce, medical interventions, research resource allocation
- MeSH terms
- Workforce, Humans, Publishing, Registries, Review Literature as Topic, Task Performance and Analysis, Databases, Bibliographic, Information Storage and Retrieval, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. https://app.cochat.ai/papers/10.1136/bmjopen-2016-012545
- The paper
- Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017). Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. BMJ Open. https://doi.org/10.1136/bmjopen-2016-012545
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.