Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry
Open accessThe DOI matches its Crossref record; 26 of the 29 references it cites were found in a registry or an index; 2 of the 3 sources its claims cite were checked for support.
Abstract
OBJECTIVES: To summarise logistical aspects of recently completed systematic reviews that were registered in the International Prospective Register of Systematic Reviews (PROSPERO) registry to quantify the time and resources required to complete such projects. DESIGN: Meta-analysis. DATA SOURCES AND STUDY SELECTION: All of the 195 registered and completed reviews (status from the PROSPERO registry) with associated publications at the time of our search (1 July 2014). DATA EXTRACTION: All authors extracted data using registry entries and publication information related to the data sources used, the number of initially retrieved citations, the final number of included studies, the time between registration date to publication date and number of authors involved for completion of each publication. Information related to funding and geographical location was also recorded when reported. RESULTS: The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42). The number of studies found in the literature searches ranged from 27 to 92 020; the mean yield rate of included studies was 2.94% (IQR=2.5); and the mean number of authors per review was 5, SD=3. Funded reviews took significantly longer to complete and publish (mean=42 vs 26 weeks) and involved more authors and team members (mean=6.8 vs 4.8 people) than those that did not report funding (both p<0.001). CONCLUSIONS: Systematic reviews presently take much time and require large amounts of human resources. In the light of the ever-increasing volume of published studies, application of existing computing and informatics technology should be applied to decrease this time and resource burden. We discuss recently published guidelines that provide a framework to make finding and accessing relevant literature less burdensome.
Overview
CoChat Summary
## TL;DR
Using 195 completed PROSPERO-registered systematic reviews of medical interventions, the authors estimated that reviews took a mean of 67.3 weeks to complete and publish and involved a mean of 5 authors per review. They conclude that systematic reviews are time- and labor-intensive, with funded reviews taking longer and involving more people than unfunded reviews.
## Key findings
- Across 195 completed reviews, the mean estimated time from registered project start to publication was 67.3 weeks (SD=31.0; range 6–186 weeks).
- The mean number of authors/team members was 5 (SD=3), and the mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).
- Literature searches were highly variable, with the number of studies found ranging from 27 to 92,020.
- Reviews that reported funding took longer and involved more people than those that did not report funding: 42 vs 26 weeks and 6.8 vs 4.8 people, both p<0.001.
## Methods
- Meta-analysis of PROSPERO registry records linked to completed review publications, using a sample of 195 registered and completed reviews with associated publications identified on 1 July 2014.
- Data were extracted from registry entries and publications on timing, authors/team members, funding, search sources, initial citations, and final included studies; the sample comprised 197 literature reviews from the 195 publications.
- Main analyses were descriptive summaries of means, ranges, and yield rates, plus ANOVA to compare funded vs unfunded reviews.
## Limitations
- The paper states that the study is limited by incomplete reporting in both the registry and the published articles, and that registry and publication data were cross-checked only where available.
- The authors state that the true project start date was difficult to capture, so their time estimates may be conservative and may underestimate time from the very first review activities.
- The paper notes that the data are highly skewed, making prediction of timelines statistically unsound; this is an evident limitation of the analysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
1 Valid · 1 Not valid · 1 Not checked · 23 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean number of authors per review was 5, SD=3.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42).”
- Also stated in: § Results · plain
“The mean project length (using the registered project start date to the review's publication date) was 67.3 weeks (SD=31.0; range 6–186 weeks).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean yield rate of included studies was 2.94% (IQR=2.5);”
- Also stated in: § Results · plain
“The mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plainn = 190- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reviews that reported funding took longer to complete and included more authors/team members; this difference was not seen when we considered only whether specific authors were funded.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of studies found in the literature searches ranged from 27 to 92 020;”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
9 more claims
Create a free account to see all 26 claims and every source verdict.
- Probably not a substantial claim. 11
- It may state two separate claims as one. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Typically, only a small fraction of the records belong to the relevant class, making title and abstract screening an important bottleneck in systematic reviewing process 25 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“requiring a median of five researchers and around 40 weeks of work to reach submission [ 3 , 4 ]”
From Reducing systematic review burden using Deduklick: a novel, automated, reliable, and explainable deduplication algorithm to foster medical research (2022) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“typically taking over 16 months and costing upwards of $100,000 to complete 1,2 .”
From Automation of Systematic Reviews with Large Language Models (2025) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLMs can automate critical tasks for SLRs, including screening abstracts and full texts, assessing risk of bias and extracting data for use in network meta-analyses with high accuracy, all while significantly reducing the time and costs required by using human review [2, 4–7].”
From Automated Mass Extraction of Over 680,000 PICOs from Clinical Study Abstracts Using Generative AI: A Proof-of-Concept Study. (2024) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The HTA process is very labour and resource intensive, requiring a large team of experts in the field of health economic outcomes research (HEOR), including SLR analysts, statisticians and economic modellers [5, 8].”
From Artificial Intelligence to Automate Network Meta-Analyses: Four Case Studies to Evaluate the Potential Application of Large Language Models (2024) · cites this paper as [8]
Experimental — accuracy not yet measured
18 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 3×
“…clinical trials could be a starting point for testing the use of indexing systems that employ a Population, Intervention, Comparisons, Outcomes, Study Design (PICOS) 15 structure of coding metadata for clinical trials in order to make the scienti fi c literature become a truly searchable database.”
BackgroundInfluentialThe FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“1 Since the body of primary literature has increased, conducting systematic reviews and meta-analyses has become a necessity to more accurately and comprehensively present accumulated knowledge to scienti fi c, clinical and general audiences.”
BackgroundPROSPERO: an international prospective register of systematic reviews
Wright, K. E. (2014) · Cited by 568
(1965) · Nature · doi:10.1038/205236a0 · Cited by 560
Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram
Stovold, E., Beecher, D., Foxlee, R., & Noel-Storr, A. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-54 · Cited by 356
Cited by
Items 401–500 of 671
Zürrer, W. E., Cannon, A. E., Ewing, E., Brüschweiler, D., Bugajska, J., Hild, B. F., Rosso, M., Reich, D. S., & Ineichen, B. V. (2024) · PLoS ONE · doi:10.1371/journal.pone.0311358 · Cited by 7
“The process of manual evidence synthesis is highly laborious [10].”
Zhang, Q., Pellegrini, M., Marsili, F., & Neitzel, A. J. (2024) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2024.1430355 · Cited by 3
dos Santos, Á. O., Belo, V. S., Machado, T. M., & da Silva, E. S. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2024-113123 · Cited by 5
Janoudi, G., Uzun, M., Disher, T. C., Jurdana, M., Fuzul, E., Ivkovic, J., & Hutton, B. (2025) · Value in Health · doi:10.1016/j.jval.2025.09.008 · Cited by 8
Kasireddy, E., Chow, C., Collet, J., Pourrahmat, M., & Fazeli, M. S. (2025) · Value in Health Regional Issues · doi:10.1016/j.vhri.2025.101539 · Cited by 16
Large Language Models and Machine Learning Framework for Predicting Dental Ceramics Performance
Zhou, H., Bai, Y., Chen, Y., Fan, D., Wang, P., Ji, P., & Chen, T. (2025) · International Dental Journal · doi:10.1016/j.identj.2025.109358 · Cited by 5
“41 In addition, the screening scope expanded from several hundred publications to over ten thousand studies.”
An overview of artificial intelligence approaches for automating evidence synthesis
Harasgama, S., Pearce, H., Loftus, L., Painter, H., & Ford, J. A. (2026) · Public Health · doi:10.1016/j.puhe.2026.106220 · Cited by 5
Brini, S., & Leung, T. I. (2026) · Journal of Medical Internet Research · doi:10.2196/92132 · Cited by 8
“However, their value and credibility are under constant pressure from two major challenges: methodological pitfalls that can generate misleading or statistically unreliable conclusions [1-5] and a laborious, time-consuming process that can delay the translation of critical findings for years [6].”
Gates, M., Elliott, S. A., Gates, A., Sebastianski, M., Pillay, J., Bialy, L. M., & Hartling, L. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01665-x · Cited by 4
“Page 3/18 requiring substantial inputs of time and resources to produce [1, 3, 4].”
BackgroundRitchie, M. J., Smith, J. L., Kim, B., Woodward, E. N., & Kirchner, J. E. (2024) · Frontiers in Health Services · doi:10.3389/frhs.2024.1304694 · Cited by 4
Maleki, F., & Karami, M. (2024) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12665 · Cited by 4
Sandner, E., Hu, B., Simiceanu, A., Fontana, L., Jakovljevic, I., Henriques, A., Wagner, A., & Gütl, C. (2024) · International Conference on Foundation and Large Language Models (FLLM) · doi:10.1109/fllm63129.2024.10852425 · Cited by 6
Kartchner, D., Turner, H., Ye, C., Al-Hussaini, I., Nursal, B., Lee, A. J. B., Deng, J., Curtis, C., Cho, H., Duvaris, E. L., et al. (2025) · Bioengineering · doi:10.3390/bioengineering12050486 · Cited by 7
Baird, H. B. G., Kodali, P., Gallegos, M., Newton, W. N., Jenkins, S., Slone, H. S., & Pullen, W. M. (2025) · Journal of Experimental Orthopaedics · doi:10.1002/jeo2.70341 · Cited by 4
“In the past, manual bibliometric analysis was the typical method for uncovering large patterns within research, but it has become more time and labour ‐ intensive, compelling new solutions that are more ef fi cient and large ‐ scale like AI ‐ driven topic modelling [4, 25].”
The Evolution of a Mediated Systematic Review Search Service
Russell, F., Grbin, L., Beard, F., Higgins, J., & Kelly, B. (2022) · Journal of the Australian Library and Information Association · doi:10.1080/24750158.2022.2029143 · Cited by 9
“Anecdotally, many researchers lose confidence in their complex searching skills, and without support, a review’s value may be impacted, as search quality underpins evidence summaries (Borah et al., 2017; Przybyła et al., 2018).”
BackgroundInfluentialUsing systematic reviews to inform environmental policy-making
Miljand, M., & Eckerberg, K. (2022) · Evaluation · doi:10.1177/13563890221076540 · Cited by 7
“Researchers have tried to estimate the time, and in the medical field some have estimated 6-18 months (Smith et al., 2011) and others find a mean of 67.3 weeks (Borah et al., 2017).”
BackgroundInfluentialTufănaru, C., Surian, D., Scott, A. M., Glasziou, P., & Coiera, E. W. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.10.013 · Cited by 4
Dense Retrieval with Continuous Explicit Feedback for Systematic Review Screening Prioritisation
Mao, X., Zhuang, S., Koopman, B., & Zuccon, G. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657921 · Cited by 9
Baird, H. B. G., Allen, W., Gallegos, M., Ashy, C. C., Slone, H. S., & Pullen, W. M. (2025) · Arthroscopy Sports Medicine and Rehabilitation · doi:10.1016/j.asmr.2025.101108 · Cited by 3
“Traditional methods for analyzing research patterns, such as manual bibliometric analysis, are often time-consuming, labor-intensive, and quickly outdated, 7,8 necessitating the adoption of more ef fi cient and scalable approaches like AI-driven topic modeling.”
Ng, H. K. Y., & Chan, L. C. H. (2024) · International Workshop on Artificial Intelligence and Education (WAIE) · doi:10.1109/waie63876.2024.00033 · Cited by 7
“Previous research has suggested applying computing and informatics technology to decrease the time and resource burden [20] [23] [24].”
InfluentialDenseReviewer: A Screening Prioritisation Tool for Systematic Review Based on Dense Retrieval
Mao, X., Leelanupab, T., Scells, H., & Zuccon, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88720-8_11 · Cited by 5
Comparison of Artificial Intelligence with a Conventional Search in Dermatology
Kaul, S., Jakhar, D., & Sinha, S. (2022) · Indian Dermatology Online Journal · doi:10.4103/idoj.idoj_264_21 · Cited by 3
“[2] However, recent advances in natural language processing (NLP) and machine learning have enabled “artificial intelligence” (AI) to “learn” through algorithms and assist with text classification and data extraction.”
BackgroundAUTOMETA: Automatic Meta-Analysis System Employing Natural Language Processing
Mutinda, F. W., Yada, S., Wakamiya, S., & Aramaki, E. (2022) · Studies in health technology and informatics · doi:10.3233/shti220150 · Cited by 6
Leenaars, C. H. C., Stafleu, F. R., Häger, C., Nieraad, H., & Bleich, A. (2024) · Scientific Reports · doi:10.1038/s41598-024-60389-9 · Cited by 4
Abògúnr̀in, Ṣ., Queiros, L., Bednarski, M., Sumner, M., Baehrens, D., & Witzmann, A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.09.30.462652 · Cited by 3
Lee, K., Datta, S., Paek, H., Rastegar-Mojarad, M., Huang, L., He, L., Wang, S., Wang, J., & Wang, X. (2024) · medRxiv · doi:10.1101/2024.07.03.24309897 · Cited by 6
“Conducting and publishing a single SLR typically takes between 12 to 24 months 8 , with an average duration of approximately 17 months 9 .”
BackgroundJanoudi, G., Uzun, M., Jurdana, M., Fuzul, E., & Ivkovic, J. (2024) · medRxiv · doi:10.1101/2024.09.06.24313186 · Cited by 3
Janoudi, G., Uzun, M., Jurdana, M., & Hutton, B. (2025) · medRxiv · doi:10.1101/2025.02.11.25322087 · Cited by 3
Kline, E. (2023) · Journal of Graduate Librarianship · doi:10.59942/2995-9063.1008 · Cited by 4
Nitturi, V., Flores, Á., & Bauer, D. F. (2025) · Neurosurgery · doi:10.1227/neu.0000000000003450 · Cited by 3
Rubinstein, M., Grant, S., Griffin, B. A., Pessar, S. C., & Stein, B. D. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70031 · Cited by 4
Assessing risk of bias of cohort studies with large language models
Xia, D., Lai, H., Zhao, W., Huang, J., Liu, J., Ye, Z., Liu, J., Sun, M., Hou, L., Pan, B., et al. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10028 · Cited by 4
How long does it take to complete and publish a systematic review of animal studies?
Bugajska, J., Hild, B. F., Brüschweiler, D., Meier, E., Bannach‐Brown, A., Wever, K. E., & Ineichen, B. V. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02672-5 · Cited by 4
“In addition to that, researchers often wonder about the time it takes to complete and publish an animal systematic review [17, 18].”
Combining large language models enhances screening sensitivity in systematic reviews
CASSAI, A. D., Dost, B., Karapınar, Y. E., Turunç, E., Boscolo, A., & Navalesi, P. (2025) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2025.112030 · Cited by 4
Large language model enhanced framework for systematic reviews and meta-analyses
Shen, J., Luo, Z.-Y., Jia, D., Wang, S.-R., Sun, F., & Wu, J.-G. (2025) · BMJ digital health & AI · doi:10.1136/bmjdhai-2025-000017 · Cited by 6
“49 LLMs may assist by applying techniques such as named entity recognition, relation extraction and table or figure parsing to identify relevant data from both textual and visual elements.”
Courvoisier, D. S., Buitrago‐García, D., Buclin, C. P., Bürgisser, N., Iudici, M., & Mongin, D. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10054 · Cited by 6
“6 One of the main tasks is the selection of studies based on their abstract and title.”
König, L., Zitzmann, S., & Hecht, M. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10053 · Cited by 5
“12 Thereby, a considerable portion of the workload involves searching and screening for relevant articles.”
Yao, X., Saha, A., Low, A., Ahmed, S., Ali, S., Misra, A., Abdelmalek, M., Saravanan, S., & SUSSMAN, J. S. (2025) · Intelligent Medicine · doi:10.1016/j.imed.2025.12.008 · Cited by 3
Fagerberg, P., Sallander, O., Patil, K. V., Berg, A., Nyman, A., Borg, N., & Lindén, T. (2026) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70082 · Cited by 6
Konzett, V., Laskou, F., Smolen, J. S., Edwards, C. J., Aletaha, D., van der Heijde, D. M. F. M., Winthrop, K. L., Takeuchi, T., Caporali, R. F., Verschueren, P., et al. (2026) · Annals of the Rheumatic Diseases · doi:10.1016/j.ard.2026.05.006 · Cited by 5
Hilkenmeier, F., Stoltenberg, M., & Stierle, C. M. G. (2026) · Systematic Reviews · doi:10.1186/s13643-026-03228-4 · Cited by 8
“…pose significant barriers for smaller research groups, research groups from low-and middle-income countries, or research groups in underfunded research areas from conducting systematic reviews, simply due to constraints in manpower and resources ([6, 58] also see [8, 26] for related arguments).”
InfluentialAutomatic extraction of quantitative data from ClinicalTrials.gov to conduct meta-analyses
Fanshawe, T. R., & Perera, R. (2019) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2019-111206 · Cited by 3
Soltmann, B., Lange, T., Deckert, S., Riedel-Heller, S. G., Gühne, U., Jessen, F., Bauer, M., Schmitt, J. M., & Pfennig, A. (2023) · Der Nervenarzt · doi:10.1007/s00115-023-01505-4 · Cited by 2
“schinelles Lernen, Crowdsourcing) unterstützt werden, sind aber noch nicht in die routinemäßige Leitlinienentwicklung integriert [7].”
BackgroundLeenaars, C. H. C., Häger, C., Stafleu, F. R., Nieraad, H., & Bleich, A. (2023) · Diagnostics · doi:10.3390/diagnostics13193098 · Cited by 3
“However, SRs generally take a long time to complete, with a median of 66 weeks and extremes up to 186 from start to completion [51].”
BackgroundPosso, M., & Sala, M. (2024) · Cirugía Española (English Edition) · doi:10.1016/j.cireng.2024.04.004 · Cited by 3
Sínteses de evidências para apoio à tomada de decisões relacionadas à pandemia de covid-19
de Andrade, K. R. C., Carvalho, V. K. D. S., Silva, R. B., Luquine, C. D., Farinasso, C. M., Oliveira, C. D. F., Mascarenhas, F., de Paula, G. A. R., de Toledo, I. P., Marinho, M. M. A., et al. (2024) · Revista de Saúde Pública · doi:10.11606/s1518-8787.2024058005226 · Cited by 2
“However, their elaboration period, in many cases, exceeds the time to inform decisions during public health crises 4 .”
BackgroundWilson, G., Brewer, H. R., Flanagan, J. M., von Wagner, C., & Hirst, Y. (2024) · European Journal of Cancer Care · doi:10.1155/2024/5580195 · Cited by 3
Tomotaki, A., Kodama, Y., & Futami, A. (2024) · Journal of Japan Academy of Nursing Science · doi:10.5630/jans.44.117 · Cited by 2
Accelerating Systematic Reviews Via Natural Language Processing
Nasser, F., Trad, F. S., Chakhtoura, M., Fuleihan, G. E., & Chehab, A. (2024) · International Conference on Computer and Applications (ICCA) · doi:10.1109/icca62237.2024.10927953 · Cited by 2
“Consequently, the duration for publishing a review can vary significantly, ranging from 6 weeks to as much as 186 weeks (equivalent to around 3 and a half years), depending on the size of the original set of articles [6].”
Liu, R., Li, J., Zivkovic, M., & Abbasi, A. (2025) · MIS Quarterly · doi:10.25300/misq/2024/18573 · Cited by 10
“Consequently, the average completion time for a manual SR project is 67.3 weeks (Borah et al., 2017), leading to many studies being outdated by the time they are published (Marshall & Wallace, 2019).”
InfluentialCamilleri, M., Gogolishvili, D., Giliauskas, D. L., Globerman, J., & Wilson, M. G. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-019-0476-4 · Cited by 3
“The rapid response process at the OHTN was developed with a commitment to respond to questions from ASOs and other CBOs by systematically and transparently identifying and synthesising relevant research evidence in days or weeks (as opposed to months or years, as can be the case with traditional systematic reviews [30…”
MethodSystematic reviews - incentives, pressures, and possible limitations
Kullmann, L. (2020) · International Journal of Rehabilitation Research · doi:10.1097/mrr.0000000000000402 · Cited by 3
“It seems from recent publications and my own editorial/reviewer experiences these points may often be overlooked, although they have been raised repeatedly (Jadad et al., 1997; Moher et al., 2016; Page and Moher, 2016; Borah et al., 2017).”
BackgroundAn introduction to carrying out and appraising systematic reviews in healthcare
Davies, A. (2023) · Journal of Paramedic Practice · doi:10.12968/jpar.2023.15.11.cpd1 · Cited by 5
La Publicación Científica en tiempos de COVID-19
Luisa Schonhaut, B., Harris, P. R., & Sch., F. C. (2020) · Revista chilena de pediatría · doi:10.32641/rchped.v91i7.2584 · Cited by 2
Understanding in vivo modelling of depression
Bannach‐Brown, A. (2019) · ERA · Cited by 2
Chen, S., Mao, B., Xie, Y., Pan, Y., Li, C., Yang, S., Li, D., & Li, B. (2021) · Research Square · doi:10.21203/rs.3.rs-713655/v1 · Cited by 2
Shen, J., Ling, F., & Hartmann, E. M. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.09.29.510210 · Cited by 2
Queiros, L., Mearns, E. S., Mccarvil, M., Alarcão, J., Garcia, M. J., & Abògúnr̀in, Ṣ. (2023) · Research Square · doi:10.21203/rs.3.rs-3119345/v1 · Cited by 4
Study screening for meta-research: An overview of AI toolsPreprint
Quan, Y., & Hui, B. (2023) · doi:10.31219/osf.io/bd6fj · Cited by 2
Nordmann, K., Schaller, M., Sauter, S., et al. (2024) · Research Square · doi:10.21203/rs.3.rs-4687319/v1 · Cited by 2
LLM-based Multi-Agent Collaboration for Abstract Screening towards Automated Systematic ReviewsPreprint
Akinseloyin, O., Jiang, X., & Palade, V. (2025) · medRxiv · doi:10.1101/2025.08.11.25333429 · Cited by 2
Fagerberg, P., Sallander, O., Patil, K. V., Berg, A., Nyman, A., Borg, N., & Lindén, T. (2025) · medRxiv · doi:10.1101/2025.09.02.25334159 · Cited by 2
Robleto, E., & Shehadeh, L. A. (2025) · American Journal of Physiology. Heart and Circulatory Physiology · doi:10.1152/ajpheart.00374.2025 · Cited by 2
Lagopoulos, A., & Tsoumakas, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09752 · Cited by 4
“%) of them are relevant at the abstract (document) level (Borah et al., 2017; Kanoulas et al., 2018).”
BackgroundMachine Learning in Evidence Synthesis Research
Carrasco‐Labra, A., Urquhart, O., & Spallek, H. (2021) · Springer eBooks · doi:10.1007/978-3-030-71881-7_12 · Cited by 2
Searching for veterinary evidence: A guide for equine professionals
White, C. N., Moberly, H. K., Fausak, E. D., et al. (2022) · Equine Veterinary Education · doi:10.1111/eve.13634 · Cited by 1
SyROCCo: enhancing systematic reviews using machine learning
Fang, Z., Arana‐Catania, M., van Lier, F.-A., Velarde, J. O., Bregazzi, H., Airoldi, M., Carter, E., & Procter, R. (2024) · Data & Policy · doi:10.1017/dap.2024.33 · Cited by 3
“A prior study indicated that the average time between registration and publication for reviews registered on PROSPERO (International Prospective Register of Systematic Reviews) is around 67 weeks (Borah et al., 2017).”
BackgroundLee, E. W., Xiong, B., Yang, C., & Ho, J. C. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679940 · Cited by 1
“For the SR task, we observe that HypMix outperforms all other baselines from 0.002 to 0.037 by comparing with the second-best AUC score.”
InfluentialMarin-Garcia, J. A., Martínez-Tomás, J., Tárraga, A. J., & Santandreu‐Mascarell, C. (2024) · WPOM - Working Papers on Operations Management · doi:10.4995/wpom.22282 · Cited by 3
Key strategies for evidence synthesis through systematic reviews in Dentistry
Agnihotry, A., Thakkar, R., Gill, K., Schoenbaum, T. R., Dobbins, M., Stevenson, R. G., Couban, R., & Ray, S. (2025) · Dentistry Review · doi:10.1016/j.dentre.2025.100152 · Cited by 2
Barrett-Catton, E., Jones, E. P., & Carlson, R. (2025) · Medical Reference Services Quarterly · doi:10.1080/02763869.2025.2471879 · Cited by 1
Qin, X., Yao, M., Luo, X., Liu, J., Ma, Y., Liu, Y., Li, H., Deng, K., Zou, K., Li, L., et al. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.3 · Cited by 1
“11 The standard method for retrieving RCTs from databases often yields results where only 7% of the retrieved citations are real RCTs, 12 making accurate identification of RCTs a crucial task when conducting SRs. 13 Although machine learning (ML) 14,15 models to accelerate the SR workflow by…”
Using Artificial Intelligence for Text Screening in a Systematic Review of Cardiotoxicity
Canfield, S. E., Aziz, M. K., Omar, M. I., N'Dow, J. M., Schijvenaars, B. J. A., Ghith, J., Ahmed, K. R., Molony, D. A., & Stenzl, A. (2025) · European Urology Open Science · doi:10.1016/j.euros.2025.09.005 · Cited by 2
“Clark et al [34] reported that a full SR was completed within 12 calendar days using a suite of automatic tools, as compared with 67 weeks taken using the traditional approach [3].”
InfluentialAI ‐Augmented Search for Systematic Reviews: A Comparative Analysis
Lookingbill, V., Khandelwal, V., Roy, K., Garimella, R., Surana, H., & Sheth, A. (2025) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.1290 · Cited by 2
Harnessing data science and artificial intelligence to advance implementation research and practice
Chan, J., Tyedmers, E., Gonzalez, M., McKay, S., Liang, S., Tiernan, G., Mazariego, C. G., Elias, J., Torres-Robles, A., & Taylor, N. (2026) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000635 · Cited by 4
Automated tools in systematic reviews: Current trends
Maurya, I., Lohiya, A., Maurya, R. G., & Garg, R. K. (2025) · Indian Journal of Anaesthesia · doi:10.4103/ija.ija_1008_25 · Cited by 4
“[1] To overcome these challenges, the integration of automated tools has emerged as an advancement which enhances both the efficiency and quality of SRMA.”
Yadav, V., Trushna, T., Mandal, U. K., Singh, M., Goel, A. D., Bairwa, M. L., Dabar, D., & Sabde, Y. (2025) · Medical Reference Services Quarterly · doi:10.1080/02763869.2025.2595567 · Cited by 3
“32 Furthermore, due to the rapidly evolving field of evidence, new studies may become available during the lengthy review process, potentially making the completed review outdated by the time it is released.”
Conducting Systematic Reviews in a Day: Enter Artificial Intelligence
Cao, C., & Moher, D. (2026) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.25.01373 · Cited by 1
Topic-specific living databases of clinical trials: A scoping review of public databases
Boesen, K., Hemkens, L. G., Janiaud, P., & Hirt, J. (2026) · Clinical Trials · doi:10.1177/17407745251400635 · Cited by 2
Attribution of credit in acknowledgements: The case of systematic reviews in medicine
Salandra, R., Miraldo, M., & Criscuolo, P. (2026) · PLoS ONE · doi:10.1371/journal.pone.0338714 · Cited by 1
“Receiving external funding might be considered a proxy for quality, as externally funded reviews are more resource-intensive and take longer to complete [56].”
Nordmann, K., Schaller, M., Sauter, S., & Fischer, F. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf098 · Cited by 4
Koh, Z. H., Zarnegar, A., Skues, J., & Murray, G. (2026) · BMC Research Notes · doi:10.1186/s13104-026-07651-7 · Cited by 2
Five methodological considerations for validating LLMs in risk of bias assessment
Sahu, V. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2026.10073 · Cited by 2
Park, H. W., Shin, D. M., & Kim, N. W. (2025) · 한국의학도서관협회지 · doi:10.69528/jkmla.2025.52.1.28 · Cited by 1
Larney, S. (2026) · Drug and Alcohol Review · doi:10.1111/dar.70128 · Cited by 2
“Furthermore, all of this comes at a significant cost; it has been estimated that the average review takes at least a year to complete [26], whereas another study estimated the cost of a systematic review to be approximately US$141,000 in 2019 [27].”
Park, Y., Zhang, H.-S., & Bai, S. W. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02431-w · Cited by 3
“Indeed, according to previous research, it takes an average of 67.3 weeks for systematic reviews registered in the International Prospective Register of Systematic Reviews (PROS-PERO) to be completed 11 .”
InfluentialHunter, R. L., Booth, A., & Wood, L. (2026) · BMC Medical Research Methodology · doi:10.1186/s12874-026-02814-3 · Cited by 6
“Manual implementation of multiple search strategies is labour-intensive and time-consuming [11].”
Salzmann, M., Ramadanov, N., Prill, R., Hable, R., & Becker, R. (2026) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1002/ksa.70379 · Cited by 1
“This would optimize the currently time ‐ consuming process to such an extent that the synthesized evidence is less likely to become outdated by the time the meta ‐ analysis is completed [2, 10].”
Evaluating the performance of a custom GPT in full text screening of a systematic review
Davis, R. C., List, S. S., Chappell, K. G., Madar, A., Henjum, S., & Heen, E. (2026) · Scandinavian Journal of Public Health · doi:10.1177/14034948261423410 · Cited by 2
Screenathon 2.0: human–AI collaborative screening applied to patient-generated health data
Bergmann, J. G., Azzi, T. D. S., Neeleman, R. C., Monschau, K., Yazan, B., Jalsovec, E., Westerbeek, E., Weijdema, F., Bruin, J. D., Fang, Q., et al. (2026) · Scientific Reports · doi:10.1038/s41598-026-45385-5 · Cited by 1
Fütterer, T., König, L., Campos, D., Scherer, R., Zitzmann, S., & Hecht, M. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261442150 · Cited by 2
“However, recent studies have suggested that completing these steps can be highly time-consuming, even for experienced researchers (Borah et al., 2017; Smith et al., 2011).”
Evaluating the Utility of Artificial Intelligence in Conducting Systematic Reviews
Robert Carrier, D. O., Lopez, L., Moya, A., Hernandez, V. H., D’Apuzzo, M. R., & McNamara, C. (2026) · Arthroplasty Today · doi:10.1016/j.artd.2026.102035 · Cited by 2
“Established standards such as PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 and the Cochrane Handbook provide a foundation for comprehensive, transparent, and reproducible search strategies to support the credibility of systematic reviews [3,4].”
Automating data extraction in meta-research: A multi-model benchmark in network psychometrics papers
Šimsa, B., buts, A., Ropovik, I., & Adamkovic, M. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03052-7 · Cited by 2
“It often takes a year or more and demands significant financial resources per review (Borah et al., 2017).”
Mazzali, C., Pinciroli, T., Valetto, M. R., Dri, P., Russo, A. G., Air and Health Atlas Study Group, Angelini, P., Broccoli, S., Monti, M., Caranci, N., et al. (2026) · BMC Medical Research Methodology · doi:10.1186/s12874-026-02892-3 · Cited by 1
“It has been reported that conducting a single systematic review may require more than 1,000 h of highly skilled work [4], take on average 67 weeks from registration to publication [5], or to span overall completion times of approximately six months to two years [24].”
O’Rourke, J., Byrne, M. D., & Schroers, G. (2026) · Western Journal of Nursing Research · doi:10.1177/01939459261451723 · Cited by 1
Sušnjak, T., Palffy, C., Zimina, T., Altynbekova, N., Garg, K., & Gilbert, L. (2026) · Scientometrics · doi:10.1007/s11192-026-05681-3 · Cited by 2
“Manual thematic coding in these contexts remains valuable, but it does not scale to the current volume of literature (Borah et al., 2017; Mu and Wang, 2022).”
Pearce, H., Gkiouleka, A., Torres, O., McCann, L. J., Dicks, J. H., Loganathan, M., Rama, E., Tan, W., Barrell, A. M., & Ford, J. A. (2026) · Public Health in Practice · doi:10.1016/j.puhip.2026.100827 · Cited by 1
“Previous research has estimated that a full systematic review takes an average of 16 months from design to publication [7], by which point, findings might be outdated [8].”
Bloudek, L. M., Cichewicz, A. B., Patel, K., Sullivan, S. D., & Kallmes, K. M. (2026) · PharmacoEconomics · doi:10.1007/s40273-026-01648-7
Putman, S., Maisonneuve, H., Duhamel, A., & Clavert, P. (2017) · Orthopaedics & Traumatology Surgery & Research · doi:10.1016/j.otsr.2017.09.008 · Cited by 1
“[8] Borah R, Brown AW, Capers PL, Kaiser KA.”
BackgroundWhy equating all evidence searches to systematic reviews defies their role in information seeking
Fox, Z. E., Williams, A. M., Blasingame, M. N., Koonce, T. Y., Kusnoor, S. V., Su, J., Lee, P. J., Epelbaum, M. I., Naylor, H. M., DesAutels, S. J., et al. (2019) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2019.707 · Cited by 4
“The entire systematic review process can take upward of eighteen months to complete [14].”
Background
Metadata
- Authors
- Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A.
- Affiliations
- University of Alabama at Birmingham (US)
- Corresponding author
- Kaiser, Kathryn A
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-02
- Volume
- 7
- Issue
- 2
- Pages
- e012545
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5337708
- OpenAlex
- W2593758073
- Cited by
- 737
- References
- 29
- Citations by year
- 2026: 114 · 2025: 129 · 2024: 105 · 2023: 76 · 2022: 71 · 2021: 80 · 2020: 87 · 2019: 42 · 2018: 24 · 2017: 9
- FWCI
- 10.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- IUScholarWorks Open (Indiana University) (submittedVersion, cc-by-nc)
- HighWire Press Open Archive (submittedVersion)
- Funders
- University of Alabama at Birmingham (P30DK056336)
- University of Alabama (P30DK056336)
- National Institutes of Health
- National Institute of General Medical Sciences (K12GM088010)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK056336)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- systematic reviews, time to publication, research workforce, medical interventions, research resource allocation
- MeSH terms
- Workforce, Humans, Publishing, Registries, Review Literature as Topic, Task Performance and Analysis, Databases, Bibliographic, Information Storage and Retrieval, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.