Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry
Open accessThe DOI matches its Crossref record; 26 of the 29 references it cites were found in a registry or an index; 2 of the 3 sources its claims cite were checked for support.
Abstract
OBJECTIVES: To summarise logistical aspects of recently completed systematic reviews that were registered in the International Prospective Register of Systematic Reviews (PROSPERO) registry to quantify the time and resources required to complete such projects. DESIGN: Meta-analysis. DATA SOURCES AND STUDY SELECTION: All of the 195 registered and completed reviews (status from the PROSPERO registry) with associated publications at the time of our search (1 July 2014). DATA EXTRACTION: All authors extracted data using registry entries and publication information related to the data sources used, the number of initially retrieved citations, the final number of included studies, the time between registration date to publication date and number of authors involved for completion of each publication. Information related to funding and geographical location was also recorded when reported. RESULTS: The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42). The number of studies found in the literature searches ranged from 27 to 92 020; the mean yield rate of included studies was 2.94% (IQR=2.5); and the mean number of authors per review was 5, SD=3. Funded reviews took significantly longer to complete and publish (mean=42 vs 26 weeks) and involved more authors and team members (mean=6.8 vs 4.8 people) than those that did not report funding (both p<0.001). CONCLUSIONS: Systematic reviews presently take much time and require large amounts of human resources. In the light of the ever-increasing volume of published studies, application of existing computing and informatics technology should be applied to decrease this time and resource burden. We discuss recently published guidelines that provide a framework to make finding and accessing relevant literature less burdensome.
Overview
CoChat Summary
## TL;DR
Using 195 completed PROSPERO-registered systematic reviews of medical interventions, the authors estimated that reviews took a mean of 67.3 weeks to complete and publish and involved a mean of 5 authors per review. They conclude that systematic reviews are time- and labor-intensive, with funded reviews taking longer and involving more people than unfunded reviews.
## Key findings
- Across 195 completed reviews, the mean estimated time from registered project start to publication was 67.3 weeks (SD=31.0; range 6–186 weeks).
- The mean number of authors/team members was 5 (SD=3), and the mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).
- Literature searches were highly variable, with the number of studies found ranging from 27 to 92,020.
- Reviews that reported funding took longer and involved more people than those that did not report funding: 42 vs 26 weeks and 6.8 vs 4.8 people, both p<0.001.
## Methods
- Meta-analysis of PROSPERO registry records linked to completed review publications, using a sample of 195 registered and completed reviews with associated publications identified on 1 July 2014.
- Data were extracted from registry entries and publications on timing, authors/team members, funding, search sources, initial citations, and final included studies; the sample comprised 197 literature reviews from the 195 publications.
- Main analyses were descriptive summaries of means, ranges, and yield rates, plus ANOVA to compare funded vs unfunded reviews.
## Limitations
- The paper states that the study is limited by incomplete reporting in both the registry and the published articles, and that registry and publication data were cross-checked only where available.
- The authors state that the true project start date was difficult to capture, so their time estimates may be conservative and may underestimate time from the very first review activities.
- The paper notes that the data are highly skewed, making prediction of timelines statistically unsound; this is an evident limitation of the analysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
1 Valid · 1 Not valid · 1 Not checked · 23 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean number of authors per review was 5, SD=3.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42).”
- Also stated in: § Results · plain
“The mean project length (using the registered project start date to the review's publication date) was 67.3 weeks (SD=31.0; range 6–186 weeks).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean yield rate of included studies was 2.94% (IQR=2.5);”
- Also stated in: § Results · plain
“The mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plainn = 190- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reviews that reported funding took longer to complete and included more authors/team members; this difference was not seen when we considered only whether specific authors were funded.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of studies found in the literature searches ranged from 27 to 92 020;”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
9 more claims
Create a free account to see all 26 claims and every source verdict.
- Probably not a substantial claim. 11
- It may state two separate claims as one. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Typically, only a small fraction of the records belong to the relevant class, making title and abstract screening an important bottleneck in systematic reviewing process 25 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“requiring a median of five researchers and around 40 weeks of work to reach submission [ 3 , 4 ]”
From Reducing systematic review burden using Deduklick: a novel, automated, reliable, and explainable deduplication algorithm to foster medical research (2022) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“typically taking over 16 months and costing upwards of $100,000 to complete 1,2 .”
From Automation of Systematic Reviews with Large Language Models (2025) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLMs can automate critical tasks for SLRs, including screening abstracts and full texts, assessing risk of bias and extracting data for use in network meta-analyses with high accuracy, all while significantly reducing the time and costs required by using human review [2, 4–7].”
From Automated Mass Extraction of Over 680,000 PICOs from Clinical Study Abstracts Using Generative AI: A Proof-of-Concept Study. (2024) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The HTA process is very labour and resource intensive, requiring a large team of experts in the field of health economic outcomes research (HEOR), including SLR analysts, statisticians and economic modellers [5, 8].”
From Artificial Intelligence to Automate Network Meta-Analyses: Four Case Studies to Evaluate the Potential Application of Large Language Models (2024) · cites this paper as [8]
Experimental — accuracy not yet measured
18 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 3×
“…clinical trials could be a starting point for testing the use of indexing systems that employ a Population, Intervention, Comparisons, Outcomes, Study Design (PICOS) 15 structure of coding metadata for clinical trials in order to make the scienti fi c literature become a truly searchable database.”
BackgroundInfluentialThe FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“1 Since the body of primary literature has increased, conducting systematic reviews and meta-analyses has become a necessity to more accurately and comprehensively present accumulated knowledge to scienti fi c, clinical and general audiences.”
BackgroundPROSPERO: an international prospective register of systematic reviews
Wright, K. E. (2014) · Cited by 568
(1965) · Nature · doi:10.1038/205236a0 · Cited by 560
Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram
Stovold, E., Beecher, D., Foxlee, R., & Noel-Storr, A. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-54 · Cited by 356
Cited by
Items 101–200 of 671
Vitamin C for COVID-19: A living systematic review
Baladía, E., Pizarro, A. B., Ortiz-Muñoz, L. E., & Gabriel Rada, G. (2020) · Medwave · doi:10.5867/medwave.2020.06.7978 · Cited by 46
Trad, F. S., Yammine, R., Charafeddine, J., Chakhtoura, M., Rahme, M., Fuleihan, G. E., & Chehab, A. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02583-5 · Cited by 62
“However, their process is labor-intensive and time-consuming, requiring authors to screen thousands of articles, with SRs taking on average 67.3 weeks to complete [1].”
InfluentialNatukunda, A., & Muchene, L. K. (2023) · Systematic Reviews · doi:10.1186/s13643-022-02163-4 · Cited by 48
“For reviews on medical interventions or environmental topics, it is estimated that approximately 97% of the initially retrieved documents are considered irrelevant for further evaluation based on the initial title and abstract screening [9, 10].”
ChatGPT for digital pathology research
Omar, M., Ullanat, V., Loda, M. F., Marchionni, L., & Umeton, R. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00114-6 · Cited by 57
“34 In medical practice and education, UpToDate announced in 2023 their AI chatbot that uses their curated knowledge base and provides contextualised evidence.”
Evaluation of text mining to reduce screening workload for injury-focused systematic reviews
Giummarra, M. J., Lau, G., & Gabbe, B. J. (2020) · Injury Prevention · doi:10.1136/injuryprev-2019-043247 · Cited by 39
“Consequently, it now typically takes more than 12 months before systematic reviews are published given the additional time required for screening, data extraction and synthesis.(3) Innovative tools are needed to keep systematic review methods cost- effective.”
BackgroundTowards evidence-based practice 2.0: leveraging artificial intelligence in healthcare
Nilsen, P., Sundemo, D., Heintz, F., Neher, M., Nygren, J., Svedberg, P., & Petersson, L. (2024) · Frontiers in Health Services · doi:10.3389/frhs.2024.1368030 · Cited by 39
Yu, Y., Shi, Q., Zheng, P., Gao, L., Li, H., Tao, P., Gu, B., Wang, D., & Chen, H. (2020) · Journal of Medical Virology · doi:10.1002/jmv.25901 · Cited by 39
“3 weeks to complete and publish an SR, and funded SRs require longer than nonfunded SRs.(57) However, the urgency associated with the outbreaks has forced researchers to shorten the time for conducting SRs.”
BackgroundA scoping review of engineering education systematic reviews
Phillips, M., Reed, J. B., Zwicky, D., & Epps, A. V. (2023) · Journal of Engineering Education · doi:10.1002/jee.20549 · Cited by 53
“SLRs and MAs are popular and widely discussed approaches, but they are time consuming, taking an average of 67.3 weeks (Borah et al., 2017), and labor intensive, as they are generally conducted in teams with multiple reviewers (Borrego et al., 2015).”
InfluentialYao, X., Kumar, M. V., Su, E., Flores Miranda, A., Saha, A., & Sussman, J. (2024) · Cancer Epidemiology · doi:10.1016/j.canep.2023.102511 · Cited by 37
Catchii: Empowering literature review screening in healthcare
Halman, A., & Oshlack, A. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1675 · Cited by 40
“All in all, a substantial cost can be incurred by researchers as a systematic review takes around 15 months on average to complete and publish [9], and the use of two reviewers for screening is the current standard to prevent missing papers [10].”
BackgroundBedenlier, S., Bond, M., Buntins, K., Zawacki‐Richter, O., & Kerres, M. (2019) · Springer eBooks · doi:10.1007/978-3-658-27602-7_7 · Cited by 51
Runjić, E., Rombey, T., Pieper, D., & Puljak, L. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.08.010 · Cited by 35
Koensgen, N., Rombey, T., Allers, K., Mathes, T., Hoffmann, F., & Pieper, D. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.012 · Cited by 34
How to Conduct a Systematic Review and Meta-Analysis: A Guide for Clinicians
Zaccagnini, M., & Li, J. (2023) · Respiratory Care · doi:10.4187/respcare.10971 · Cited by 51
“36 Table 1 includes the major differences between narrative, scoping, and systematic reviews.”
Key concepts in rapid reviews: an overview
Devane, D., Hamel, C., Gartlehner, G., Nußbaumer-Streit, B., Griebler, U., Affengruber, L., Saif‐Ur‐Rahman, K., & Garritty, C. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111518 · Cited by 43
Andersen, T. H., Marcussen, T. M., Termannsen, A., Lawaetz, T. W. H., & Nørgaard, O. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70036 · Cited by 63
WHICH DATABASES SHOULD BE USED TO IDENTIFY STUDIES FOR SYSTEMATIC REVIEWS OF ECONOMIC EVALUATIONS?
Arber, M. R., Glanville, J., Isojärvi, J., Baragula, E., Edwards, M., Shaw, A., & Wood, H. (2018) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462318000636 · Cited by 37
“Conducting SRs requires significant resources and the search approaches used, including the choice of databases to search, can impact on these resources (7).”
BackgroundSharma, R. S., & Mishra, D. K. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.125346 · Cited by 44
Rapid evidence synthesis approach for limits on the search date: How rapid could it be?
Xu, C., Ju, K., Lin, L., Jia, P., Kwong, J. S. W., Syed, A., & Furuya‐Kanamori, L. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1525 · Cited by 40
“As a result, it is often time-consuming and requires 6 months to 2 years to complete.(3,4) Such long periods may not be well-suited for the needs of decision-makers to make timely decisions, especially when they are facing urgent public health events.”
BackgroundChaboyer, W. P., Coyer, F. M., Harbeck, E., Thalib, L., Latimer, S. L., Wan, C. S., Tobiano, G., Griffin, B. R., Campbell, J., Walker, R., et al. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2022.104189 · Cited by 33
König, L., Zitzmann, S., Fütterer, T., Campos, D., Scherer, R., & Hecht, M. (2023) · doi:10.31234/osf.io/ybu3w · Cited by 33
Comparing machine and human reviewers to evaluate the risk of bias in randomized controlled trials
Armijo‐Olivo, S., Craig, R., & Campbell, S. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1398 · Cited by 31
“Knowledge synthesis products such as health technology assessments (HTAs) and systematic reviews (SRs) are important sources of high-quality information for policy makers, and the production of these assessments and reports requires expertise, human resources, and time.(1) Given the proliferation of health technologie…”
BackgroundBurgard, T., & Bittermann, A. (2023) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000509 · Cited by 29
Systematic reviews of the literature: a better way of addressing basic science controversies
O’Hagan, E. C., Matalon, S., & Riesenberg, L. A. (2018) · American Journal of Physiology-Lung Cellular and Molecular Physiology · doi:10.1152/ajplung.00544.2017 · Cited by 40
“The process of completing a systematic review is lengthy with the average review taking ~16 mo to complete and publish (2).”
BackgroundRombey, T., Allers, K., Mathes, T., Hoffmann, F., & Pieper, D. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0698-8 · Cited by 34
Living Health Technology Assessment: Issues, Challenges and Opportunities
Thokala, P., Srivastava, T., Smith, R. A., Ren, S., Whittington, M. D., Elvidge, J., Wong, R., & Uttley, L. (2023) · PharmacoEconomics · doi:10.1007/s40273-022-01229-4 · Cited by 45
Zero-Shot Information Extraction for Clinical Meta-Analysis using Large Language Models
Kartchner, D., Ramalingam, S. S., Al-Hussaini, I., Kronick, O., & Mitchell, C. S. (2023) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2023.bionlp-1.37 · Cited by 59
“A recent survey found that most clinical meta-analyses require 6-10 months of data gathering and analysis for 5 individuals (Borah et al., 2017), which does not account for research development time spent before registering meta-analyses on PROSPERO registry of systematic reviews (Booth et al.,…”
BackgroundPerlman‐Arrow, S., Loo, N., Bobrovitz, N., Yan, T., & Arora, R. K. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1636 · Cited by 30
“[4, 5] Living systematic 7 reviews are designed to circumvent delays and provide up-to-date results, [6, 7] but it is 8 similarly laborious to update these at an adequate frequency.”
BackgroundKarystianis, G., Thayer, K., Wolfe, M., & Tsafnat, G. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.04.004 · Cited by 31
Deng, Z., Yin, K., Bao, Y., Armengol, V. D., Wang, C., Tiwari, A., Barzilay, R., Parmigiani, G., Braun, D., & Hughes, K. S. (2019) · JCO Clinical Cancer Informatics · doi:10.1200/cci.19.00043 · Cited by 32
“94%.(2) In cataloging the work process, study selection, including abstract screening, is the most labor-intensive and time-consuming step, accounting for an estimated 26% of project work.”
BackgroundFadlallah, R., El‐Harakeh, A., Bou-Karroum, L., Lotfi, T., El‐Jardali, F., Hishi, L., & Akl, E. A. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.12.009 · Cited by 35
Automation of Systematic Reviews with Large Language Models
Cao, C., Arora, R., Cento, P., Budak, A., Manta, K., Farahani, E., Cecere, M., Selemon, A., Sang, J., Gong, L. X., et al. (2025) · medRxiv · doi:10.1101/2025.06.13.25329541 · Cited by 33
Data extraction methods for systematic review (semi)automation: A living review protocol.
Schmidt, L., Olorisade, B. K., McGuinness, L. A., Thomas, J., & Higgins, J. P. T. (2020) · F1000Research · doi:10.12688/f1000research.22781.2 · Cited by 30
Limits in the search date for rapid reviews of diagnostic test accuracy studies
Furuya‐Kanamori, L., Lin, L., Kostoulas, P., Clark, J. M., & Xu, C. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1598 · Cited by 37
“As a result, it is estimated that well-conducted systematic reviews could take 6 months to 2 years and up to $200,000 to complete.(2) Such long periods are often not practical as evidence could already be outdated by the time it is published, especially in the case of an outbreak or pandemic, when clinicians need time…”
BackgroundAkl, E. A., Haddaway, N., Gabriel Rada, G., & Lotfi, T. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.025 · Cited by 32
Scaccia, J., & Scott, V. C. (2021) · Implementation Science · doi:10.1186/s13012-021-01120-4 · Cited by 37
“The average time to complete and publish a systematic review is 67.3 weeks (1.3 years) [10].”
BackgroundInfluentialKönig, L., Zitzmann, S., Fütterer, T., Campos, D., Scherer, R., & Hecht, M. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1762 · Cited by 40
“2 Especially the literature search and screening of abstracts constitute a substantial portion of the workload.”
Accuracy of Large Language Models for Literature Screening in Thoracic Surgery: Diagnostic Study
Dai, Z.-Y., Wang, F., Shen, C., Ji, Y.-L., Li, Z.-Y., Wang, Y., & Pu, Q. (2025) · Journal of Medical Internet Research · doi:10.2196/67488 · Cited by 45
“This process traditionally involves extensive effort in identifying and retrieving relevant literature [5,6].”
On the development and application of EMMIE: insights from the What Works Centre for Crime Reduction
Thornton, A. E., Sidebottom, A., Belur, J., Tompson, L., & BOWERS, K. J. (2018) · Policing & Society · doi:10.1080/10439463.2018.1539483 · Cited by 29
“Conducting these three reviews brought home the resource-intensive nature of systematic reviews more generally (see Borah et al. 2017), but especially one that aims to combine meta-analysis with realist synthesis.”
BackgroundLeenaars, C. H. C., Tsaioun, K., Stafleu, F. R., Rooney, K. B., Meijboom, F. L. B., Ritskes-Hoitinga, M. J., & Bleich, A. (2020) · Laboratory Animals · doi:10.1177/0023677220968599 · Cited by 37
“3 weeks on average from registered start to publication, with a range of 6 to 186 weeks.(11) As time may be limited, we provide estimates on the time needed for the different steps in the review process, which depend on the amount of literature included.”
BackgroundRecent research into healthcare professions regulation: a rapid evidence assessment
Browne, J., Bullock, A., Poletti, C., & Cserző, D. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06946-8 · Cited by 29
Decoding semi-automated title-abstract screening: findings from a convenience sample of reviews
Gates, A., Gates, M., DaRosa, D., Elliott, S. A., Pillay, J., Rahman, S., Vandermeer, B., & Hartling, L. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01528-x · Cited by 31
Rajit, D., Johnson, A. T., Callander, E. J., Teede, H. J., & Enticott, J. (2024) · Health Research Policy and Systems · doi:10.1186/s12961-023-01095-2 · Cited by 31
“This process presents the most time-consuming part of EBG development, with the average systematic review requiring just over a year (67 weeks on average [26]) to complete, and costing US$ 141 194.80 per review [27].”
BackgroundInfluentialYe, A., Maiti, A., Schmidt, M. W., & Pedersen, S. (2024) · Future Internet · doi:10.3390/fi16050167 · Cited by 45
A foundation model for human-AI collaboration in medical literature mining
Wang, Z., Cao, L., Jin, Q., Chan, J., Wan, N., Afzali, B., Cho, H.-J., Choi, C.-I., Emamverdi, M., Gill, M. K., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-62058-5 · Cited by 62
Single screening or double screening for study selection in systematic reviews?
Mahtani, K. R., Heneghan, C. J., & Aronson, J. K. (2019) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2019-111269 · Cited by 30
Lunny, C., Reid, E. K., Neelakant, T., Chen, A., Zhang, J. H., Shinger, G., Stevens, A., Tasnim, S., Sadeghipouya, S., Adams, S., et al. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1542 · Cited by 32
“5 weeks).(54) The cost of conducting a systematic review is considerable, recently estimated at $141,000 USD.”
BackgroundEditorial: Systematic review automation thematic series
Lau, J. (2019) · Systematic Reviews · doi:10.1186/s13643-019-0974-z · Cited by 27
Arno, A., Thomas, J., Wallace, B., Marshall, I. J., McKenzie, J. E., & Elliott, J. (2022) · Annals of Internal Medicine · doi:10.7326/m22-0092 · Cited by 30
“On average, systematic reviews of health care interventions require 67 weeks to complete and publish (1), and only a minority of reviews are updated regularly (2).”
BackgroundCarey, N., Harte, M., & McCullagh, L. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.05.017 · Cited by 28
Mutinda, F. W., Liew, K., Yada, S., Wakamiya, S., & Aramaki, E. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01897-4 · Cited by 27
“Previous research showed that on average it takes about 67 weeks, from registration to publication, to finalize a meta-analysis [4].”
BackgroundReproducibility and replicability of systematic reviews
Shokraneh, F. (2019) · World Journal of Meta-Analysis · doi:10.13105/wjma.v7.i3.66 · Cited by 29
Abogunrin, S., Muir, J. M., Zerbini, C., & Sarri, G. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1454245 · Cited by 27
Assessing the Ability of ChatGPT to Screen Articles for Systematic Reviews
Syriani, E., David, I., & Kumar, G. (2023) · arXiv · doi:10.48550/arxiv.2307.06464 · Cited by 27
Occupational therapy interventions for multiple sclerosis: A scoping review
Quinn, É., & Hynes, S. M. (2020) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038128.2020.1786160 · Cited by 26
“A scoping review was also believed to be the most appropriate method given the need to include different study designs [7] as well as the resource demands involved in completing a systematic review [8].”
MethodOrel, E., Ciglenečki, I., Thiabaud, A., Temerev, A., Calmy, A., Keiser, O., & Merzouki, A. (2023) · Journal of Medical Internet Research · doi:10.2196/39736 · Cited by 44
Gates, A., Gates, M., Sim, S., Elliott, S. A., Pillay, J., & Hartling, L. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01354-2 · Cited by 28
Tercero-Hidalgo, J. R., Khan, K. S., Bueno‐Cavanillas, A., López, R. F., Huete, J. F., Amezcua‐Prieto, C., Zamora, J., & Fernández-Luna, J. M. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.04.027 · Cited by 24
“On average, it takes 15months for teams of five reviewers to complete a traditional systematic review [51], with estimated screening error rates of around 10% [52].”
A systematic literature review on SME internationalization: a personality lens
Munteanu, D., Vanderstraeten, J., van Witteloostuijn, A. C., & Cambré, B. (2022) · Management Review Quarterly · doi:10.1007/s11301-022-00279-4 · Cited by 37
“Firstly, given that systematic reviews are resource intensive (Borah et al. 2017), the planning and review protocol was developed by a review panel of several researchers Table 1 Search terms Personality “Emotional intelligence” OR “attitude*” OR “values” OR “openness to experience” OR “conscientiousness” OR “extraver…”
Saldanha, I. J., Lindsley, K. B., Lum, F., Dickersin, K., & Li, T. (2019) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2019.1063 · Cited by 26
Panayi, A., Ward, K., Benhadji-Schaff, A., Ibanez-Lopez, A. S., Xia, A., & Barzilay, R. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02351-w · Cited by 23
“In a study of 195 records analysed in the PROSPERO registry, the mean length of time taken to conduct an SLR was 67.3 weeks (standard deviation [SD] 31.0 weeks, range 6–186 weeks) [4], with an economic analysis estimating the cost of each SLR at US $141,195 [5].”
BackgroundInfluentialHay‐Smith, J., Englas, K., Dumoulin, C. L., Ferreira, C. H. J., Frawley, H., & Weatherall, M. (2019) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.19.05791-5 · Cited by 25
Burns, J. K., Etherington, C., Cheng‐Boivin, O., & Boet, S. (2021) · Health Information & Libraries Journal · doi:10.1111/hir.12413 · Cited by 35
Systematic reviews: Key concepts for health professionals
Sgarbossa, N. J., Cobaisse, M. I., Cianciulli, G. G., Bracchiglione, J., & Franco, J. V. A. (2022) · Medwave · doi:10.5867/medwave.2022.09.2622 · Cited by 44
Assessing the Integrity of Clinical Trials Included in Evidence Syntheses
Núñez‐Núñez, M., Ibáñez, N. C., Zamora, J., Bueno‐Cavanillas, A., & Khan, K. S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20126138 · Cited by 26
“In the light of the ever-increasing volume of published studies, application of existing computing and informatics technology should be applied to decrease this time and resource burden” [49].”
BackgroundData Mining in Clinical Trial Text: Transformers for Classification and Question Answering Tasks
Schmidt, L., Weeds, J., & Higgins, J. P. T. (2020) · International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC) · doi:10.5220/0008945700830094 · Cited by 24
“This implies that the searches are broad (Lefebvre et al., 2019), and authors are often left to screen a large number of abstracts manually in order to identify a small fraction of relevant publications for inclusion in the SR (Borah et al., 2017).”
BackgroundSystematic review and meta-analysis of preclinical studies
Ineichen, B. V., Held, U., Salanti, G., Macleod, M. R., & Wever, K. E. (2024) · Nature Reviews Methods Primers · doi:10.1038/s43586-024-00347-x · Cited by 32
“Large-scale strategies for overcoming publication bias include registering preclinical studies 117,133 and promoting the publication of negative results 134 .”
Digital Tools to Support the Systematic Review Process: An Introduction
Schmidt, L., Cree, I. A., Campbell, F., & WCT EVI MAP group (2025) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70100 · Cited by 30
Most published meta-analyses were made available within two years of protocol registration
Andersen, M. Z., Fonnes, S., Andresen, K., & Rosenberg, J. (2021) · European Journal of Integrative Medicine · doi:10.1016/j.eujim.2021.101342 · Cited by 23
The Development of a Living Knowledge System and Implications for Future Systematic Searching
Grbin, L., Nichols, P., Russell, F., Fuller‐Tyszkiewicz, M., & Olsson, C. A. (2022) · Journal of the Australian Library and Information Association · doi:10.1080/24750158.2022.2087954 · Cited by 28
“National Science Foundation, 2019) and lengthy time periods for review completion and fi nal publication (Borah et al., 2017; Scott et al., 2021) risk practitioners or policymakers basing decisions on outdated or inaccurate data.”
BackgroundChatGPT for assessing risk of bias of randomized trials using the RoB 2.0 tool: A methods studyPreprint
Pitre, T., Jassal, T., Talukdar, J. R., Shahab, M., Ling, M., & Zeraatkar, D. (2023) · medRxiv · doi:10.1101/2023.11.19.23298727 · Cited by 27
Garritty, C., Hamel, C., Hersi, M., Butler, C., Monfaredi, Z., Stevens, A., Nussbaumer-Streit, B., Cheng, W., & Moher, D. (2020) · Health Research Policy and Systems · doi:10.1186/s12961-020-00624-7 · Cited by 21
“However, when evidence is needed to inform an emergent issue outside the traditional SR timeline of 1–2 years [3, 4], ‘rapid reviews’ (RRs) have become a practical tool to get evidence to decision-makers more quickly, often ranging from a few weeks to usually no more than 6 months [3, 5, 6].”
BackgroundMuller, A. E., Ames, H. M. R., Jardim, P. S. J., & Rose, C. J. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1541 · Cited by 21
“It has also been estimated that the average intervention review takes 1.25 years to complete, 2 and that within 2 years of publication, one of every four systematic reviews of effect within medicine and health will become outdated.”
BackgroundInfluentialHomiar, A., Thomas, J., Ostinelli, E. G., Kennett, J., Friedrich, C., Cuijpers, P. J., Harrer, M., Leucht, S., Miguel, C., Rodolico, A., et al. (2025) · BMJ Mental Health · doi:10.1136/bmjment-2025-301762 · Cited by 46
Zawacki‐Richter, O., Cefa, B., & Bai, J. Y. H. (2025) · Review of Education · doi:10.1002/rev3.70031 · Cited by 45
Eisele‐Metzger, A., Lieberum, J.-L., Toews, M., Siemens, W., Heilmeyer, F., Haverkamp, C., Böhringer, D., & Meerpohl, J. J. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.12 · Cited by 32
Cai, X., Geng, Y., Du, Y., Westerman, B. A., Wang, D., Ma, C., & García-Vallejo, J. J. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02569-3 · Cited by 38
“However, almost no study has investigated its application in compensating or substituting human effort spent on filtering records during meta-analysis, a key issue because of the exponentially increased number of primary literature and systemic reviews required by medical researchers nowadays [11].”
Assessing risk of bias in toxicological studies in the era of artificial intelligence
Härtung, T., Hoffmann, S., & Whaley, P. (2025) · Archives of Toxicology · doi:10.1007/s00204-025-03978-5 · Cited by 33
“Borah et al. (2017) quantify the time and resources required for systematic reviews, highlighting the potential benefits of AI-assisted approaches in toxicology.”
Jap, J., Saldanha, I. J., Smith, B. T., Lau, J., Schmid, C. H., Li, T., & on behalf of the Data Abstraction Assistant Investigators (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1326 · Cited by 20
“12 With an ever ‐ growing size of the body of relevant evidence in most topic areas, this duration is likely to get even longer.”
BackgroundPapers that summarise other papers (systematic reviews and meta‐analyses)
Greenhalgh, T., & Dijkstra, P. (2024) · Wiley eBooks · doi:10.1002/9781394206933.ch9 · Cited by 19
Šuster, S., Baldwin, T., Lau, J. H., Yepes, A. J., Martínez, D., Otmakhova, Y., & Verspoor, K. M. (2023) · Journal of Medical Internet Research · doi:10.2196/35568 · Cited by 27
“Estimates of the time needed to complete a systematic review vary but can easily reach 1000 hours of (highly skilled) manual labor [5,6].”
Fromm, Y. M., Martin, F., Gezer, T., & Ifenthaler, D. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-025-09819-9 · Cited by 43
“Systematic reviews in educational sciences require a collaborative team to distribute the workload effectively (Borah et al., 2017; Zawacki-Richter, 2020).”
InfluentialSharp, M. K., Baki, D. A. B. A., Quigley, J. M., Tyner, B., Devane, D., Mahtani, K. R., Smith, S. M., O’Neill, M., Ryan, M., & Clyne, B. (2022) · Implementation Science · doi:10.1186/s13012-022-01243-2 · Cited by 19
“The yield rate is slightly lower than previous estimates likely due to the breadth of stakeholders, summary formats, and outcomes of interest [38, 39].”
ResultKarabacak, M., Jagtiani, P., Jain, A., Panov, F. E., & Margetis, K. D. (2024) · Epilepsia · doi:10.1111/epi.17890 · Cited by 24
“10,11 This slow pace can impede the timely application of new research findings and delay the recognition of meaningful patterns and shifts in the field.”
BackgroundComparative analysis of Cochrane and non-Cochrane reviews over three decades
Andersen, M. Z., Zeinert, P., Rosenberg, J., & Fonnes, S. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02531-2 · Cited by 22
“Cochrane reviews are known to take a long time to complete [21–23] compared with systematic reviews [24–26].”
BackgroundFrom insight to innovation: Harnessing artificial intelligence for dynamic literature reviews
Buetow, S., & Lovatt, J. (2024) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2024.102901 · Cited by 28
Toolkit of methodological resources to conduct systematic reviews
Figuls, M. R. I., García, L. M., Solà, I., Alonso‐Coello, P., Bonfill, X., & Zamora, J. (2020) · F1000Research · doi:10.12688/f1000research.22032.2 · Cited by 28
What's hot and what's not – Identifying publication trends in insect ecology
Andrew, N. R., Evans, M. J., Svejcar, L. N., Prendegast, K., Mata, L., Gibb, H., Stone, M. J., & Barton, P. S. (2021) · Austral Ecology · doi:10.1111/aec.13052 · Cited by 21
Living systematic review: new inputs and challenges
Vergara-Merino, L., Verdejo, C., Carrasco, C., & Vargas-Peirano, M. (2020) · Medwave · doi:10.5867/medwave.2020.11.8092 · Cited by 18
Dhrangadhariya, A., & Müller, H. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooac107 · Cited by 18
“Manually analyzing PICO information from thousands of publications for a single SR often takes 2–8 months of 2 medical experts’ time.(2) It can be automated using machine learning (ML) by directly pointing the human reviewers to the PICO descriptions, facilitating quick decision-making for the study’s relevance.”
MethodStreamlining evidence based clinical recommendations with large language models
Li, D., Jiang, N., Huang, K., Tu, R., Ouyang, S., Yu, H., Lin, Q., Chen, Y., Zhou, T., Tong, D., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02273-y · Cited by 29
Armstrong, M. E., Tornblad, M. K., & Jones, K. S. (2020) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181320641329 · Cited by 23
Pavel, A., Saarimäki, L. A., Möbus, L., Federico, A., Serra, A., & Greco, D. (2022) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2022.08.061 · Cited by 22
“With the growing volume of research studies, this problem becomes more challenging [86].”
BackgroundMuller, A. E., Berg, R. C., Meneses-Echavez, J. F., Ames, H. M. R., Borge, T. C., Jardim, P. S. J., Cooper, C., & Rose, C. J. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02171-y · Cited by 18
“Although the amount of time taken to complete health reviews varies greatly [10], 15 months has been an estimate from both a systematic review [11] and a simulation study [12].”
BackgroundUsing machine learning for continuous updating of meta-analysis in educational context
Chernikova, O., Stadler, M. J., Melev, I., & Fischer, F. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108215 · Cited by 22
Leenaars, C. H. C., de Vries, R. B., Heming, A., Visser, D. A., Holthaus, D., Reijmer, J., Elzinga, J., Kempkes, R. W. M., Punt, C., Beumer, W., et al. (2019) · Laboratory Animals · doi:10.1177/0023677219868502 · Cited by 21
“SRs are notoriously strenuous.(27) Mainly, the screening, data extraction and data analyses become more timeconsuming with larger reviews.”
BackgroundArtificial intelligence and automation of systematic reviews in women's health
Amezcua‐Prieto, C., Fernández-Luna, J. M., Huete, J. F., Bueno‐Cavanillas, A., & Khan, K. S. (2020) · Current Opinion in Obstetrics & Gynecology · doi:10.1097/gco.0000000000000643 · Cited by 17
“(cid:2) Artificial intelligence”
Ensuring Prevention Science Research is Synthesis-Ready for Immediate and Lasting Scientific Impact
Hennessy, E. A., Acabchuk, R. L., Arnold, P. A., Dunn, A. G., Foo, Y. Z., Johnson, B. T., Geange, S. R., Haddaway, N., Nakagawa, S., Mapanga, W., et al. (2021) · Prevention Science · doi:10.1007/s11121-021-01279-8 · Cited by 20
Whitton, J., & Hunter, A. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102661 · Cited by 20
“While annotation software tools are available, much of the systematic review process still requires manual input from domain specialists that is both time-consuming and expensive [9, 25].”
Method
Metadata
- Authors
- Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A.
- Affiliations
- University of Alabama at Birmingham (US)
- Corresponding author
- Kaiser, Kathryn A
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-02
- Volume
- 7
- Issue
- 2
- Pages
- e012545
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5337708
- OpenAlex
- W2593758073
- Cited by
- 737
- References
- 29
- Citations by year
- 2026: 114 · 2025: 129 · 2024: 105 · 2023: 76 · 2022: 71 · 2021: 80 · 2020: 87 · 2019: 42 · 2018: 24 · 2017: 9
- FWCI
- 10.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- IUScholarWorks Open (Indiana University) (submittedVersion, cc-by-nc)
- HighWire Press Open Archive (submittedVersion)
- Funders
- University of Alabama at Birmingham (P30DK056336)
- University of Alabama (P30DK056336)
- National Institutes of Health
- National Institute of General Medical Sciences (K12GM088010)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK056336)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- systematic reviews, time to publication, research workforce, medical interventions, research resource allocation
- MeSH terms
- Workforce, Humans, Publishing, Registries, Review Literature as Topic, Task Performance and Analysis, Databases, Bibliographic, Information Storage and Retrieval, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.