Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry
Open accessThe DOI matches its Crossref record; 26 of the 29 references it cites were found in a registry or an index; 2 of the 3 sources its claims cite were checked for support.
Abstract
OBJECTIVES: To summarise logistical aspects of recently completed systematic reviews that were registered in the International Prospective Register of Systematic Reviews (PROSPERO) registry to quantify the time and resources required to complete such projects. DESIGN: Meta-analysis. DATA SOURCES AND STUDY SELECTION: All of the 195 registered and completed reviews (status from the PROSPERO registry) with associated publications at the time of our search (1 July 2014). DATA EXTRACTION: All authors extracted data using registry entries and publication information related to the data sources used, the number of initially retrieved citations, the final number of included studies, the time between registration date to publication date and number of authors involved for completion of each publication. Information related to funding and geographical location was also recorded when reported. RESULTS: The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42). The number of studies found in the literature searches ranged from 27 to 92 020; the mean yield rate of included studies was 2.94% (IQR=2.5); and the mean number of authors per review was 5, SD=3. Funded reviews took significantly longer to complete and publish (mean=42 vs 26 weeks) and involved more authors and team members (mean=6.8 vs 4.8 people) than those that did not report funding (both p<0.001). CONCLUSIONS: Systematic reviews presently take much time and require large amounts of human resources. In the light of the ever-increasing volume of published studies, application of existing computing and informatics technology should be applied to decrease this time and resource burden. We discuss recently published guidelines that provide a framework to make finding and accessing relevant literature less burdensome.
Overview
CoChat Summary
## TL;DR
Using 195 completed PROSPERO-registered systematic reviews of medical interventions, the authors estimated that reviews took a mean of 67.3 weeks to complete and publish and involved a mean of 5 authors per review. They conclude that systematic reviews are time- and labor-intensive, with funded reviews taking longer and involving more people than unfunded reviews.
## Key findings
- Across 195 completed reviews, the mean estimated time from registered project start to publication was 67.3 weeks (SD=31.0; range 6–186 weeks).
- The mean number of authors/team members was 5 (SD=3), and the mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).
- Literature searches were highly variable, with the number of studies found ranging from 27 to 92,020.
- Reviews that reported funding took longer and involved more people than those that did not report funding: 42 vs 26 weeks and 6.8 vs 4.8 people, both p<0.001.
## Methods
- Meta-analysis of PROSPERO registry records linked to completed review publications, using a sample of 195 registered and completed reviews with associated publications identified on 1 July 2014.
- Data were extracted from registry entries and publications on timing, authors/team members, funding, search sources, initial citations, and final included studies; the sample comprised 197 literature reviews from the 195 publications.
- Main analyses were descriptive summaries of means, ranges, and yield rates, plus ANOVA to compare funded vs unfunded reviews.
## Limitations
- The paper states that the study is limited by incomplete reporting in both the registry and the published articles, and that registry and publication data were cross-checked only where available.
- The authors state that the true project start date was difficult to capture, so their time estimates may be conservative and may underestimate time from the very first review activities.
- The paper notes that the data are highly skewed, making prediction of timelines statistically unsound; this is an evident limitation of the analysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
1 Valid · 1 Not valid · 1 Not checked · 23 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean number of authors per review was 5, SD=3.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42).”
- Also stated in: § Results · plain
“The mean project length (using the registered project start date to the review's publication date) was 67.3 weeks (SD=31.0; range 6–186 weeks).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean yield rate of included studies was 2.94% (IQR=2.5);”
- Also stated in: § Results · plain
“The mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plainn = 190- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reviews that reported funding took longer to complete and included more authors/team members; this difference was not seen when we considered only whether specific authors were funded.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of studies found in the literature searches ranged from 27 to 92 020;”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
9 more claims
Create a free account to see all 26 claims and every source verdict.
- Probably not a substantial claim. 11
- It may state two separate claims as one. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Typically, only a small fraction of the records belong to the relevant class, making title and abstract screening an important bottleneck in systematic reviewing process 25 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“requiring a median of five researchers and around 40 weeks of work to reach submission [ 3 , 4 ]”
From Reducing systematic review burden using Deduklick: a novel, automated, reliable, and explainable deduplication algorithm to foster medical research (2022) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“typically taking over 16 months and costing upwards of $100,000 to complete 1,2 .”
From Automation of Systematic Reviews with Large Language Models (2025) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLMs can automate critical tasks for SLRs, including screening abstracts and full texts, assessing risk of bias and extracting data for use in network meta-analyses with high accuracy, all while significantly reducing the time and costs required by using human review [2, 4–7].”
From Automated Mass Extraction of Over 680,000 PICOs from Clinical Study Abstracts Using Generative AI: A Proof-of-Concept Study. (2024) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The HTA process is very labour and resource intensive, requiring a large team of experts in the field of health economic outcomes research (HEOR), including SLR analysts, statisticians and economic modellers [5, 8].”
From Artificial Intelligence to Automate Network Meta-Analyses: Four Case Studies to Evaluate the Potential Application of Large Language Models (2024) · cites this paper as [8]
Experimental — accuracy not yet measured
18 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 3×
“…clinical trials could be a starting point for testing the use of indexing systems that employ a Population, Intervention, Comparisons, Outcomes, Study Design (PICOS) 15 structure of coding metadata for clinical trials in order to make the scienti fi c literature become a truly searchable database.”
BackgroundInfluentialThe FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“1 Since the body of primary literature has increased, conducting systematic reviews and meta-analyses has become a necessity to more accurately and comprehensively present accumulated knowledge to scienti fi c, clinical and general audiences.”
BackgroundPROSPERO: an international prospective register of systematic reviews
Wright, K. E. (2014) · Cited by 568
(1965) · Nature · doi:10.1038/205236a0 · Cited by 560
Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram
Stovold, E., Beecher, D., Foxlee, R., & Noel-Storr, A. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-54 · Cited by 356
Cited by
Items 501–600 of 671
Ninot, G., Amadori, F., Maitre, J., Rapior, S., Rivière, L., Trouillet, R., & Carbonnel, F. (2018) · HEGEL - HEpato-GastroEntérologie Libérale · doi:10.3917/heg.081.0013 · Cited by 2
Accelerating Your Research Career with Open Science
Norris, E. (2022) · Springer eBooks · doi:10.1007/978-3-031-10754-2_9 · Cited by 1
Utomo, C. P., Maulani, C., Sukotjo, C., Fathurahman, M., & Yunan, C. A. (2022) · International Seminar on Research of Information Technology and Intelligent Systems (ISRITI) · doi:10.1109/isriti56927.2022.10052806 · Cited by 1
“The expected amount of time needed to complete an SLR vary from around nine to twelve months, depending on the question that is asked [1].”
BackgroundPGB: A PubMed Graph Benchmark for Heterogeneous Network Representation Learning
Lee, E. W., & Ho, J. C. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615128 · Cited by 4
“Current estimates for conducting an SR is 67 weeks from registration to publication [9].”
BackgroundPreclinical Evidence Synthesis Facilitates Open Science
Bilynsky, C. (2024) · Journal of Science Policy & Governance · doi:10.38126/jspg230202 · Cited by 1
“Another study analyzed preregistered systematic reviews from the PROSPERO registry and found that, on average, systematic reviews took 67.3 weeks, over a year, to complete, with around �ive authors reported per review (Borah et al. 2017) .”
BackgroundInfluentialArtificial intelligence applied in human health technology assessment: a scoping review protocol
Komoda, D. S., Cardoso, M. M. D. A., Fernandes, B. D., Visacri, M. B., & Corrêa, C. R. S. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00377 · Cited by 2
Transformative AI in Biomedicine Analysis: Applications, Challenges, and Future Directions
Tiwari, N. K. (2024) · Advances in information security, privacy, and ethics book series · doi:10.4018/979-8-3693-9311-6.ch006 · Cited by 1
Donegan, S., Connor, J., Alfirević, Ž., & Smith, C. T. (2024) · PLoS ONE · doi:10.1371/journal.pone.0315563 · Cited by 1
“…the strongest evidence to underpin healthcare decisions and can be used by guideline developers, such as the National Institute for Health and Care Excellence (NICE), to produce clinical guidelines that state treatment recommendations that health care providers follow to deliver patient care [1–5].”
Sághy, E., Elsharkawy, M., Moriarty, F., Kovács, S., Wittmann, I., & Zemplényi, A. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1495879 · Cited by 1
“Conducting manual literature reviews for systematic studies is not only labour-intensive and susceptible to human error, but also notably time-consuming, with the average estimated duration to complete and publish a systematic review being 15 – 16 months (4).”
Chung, S., Saberzadeh-Ardestani, B., Nigam, G. B., Yuan, Y., Singh, S., & Shung, D. L. (2025) · Gastroenterology · doi:10.1053/j.gastro.2025.03.034 · Cited by 3
Types and roles of reviews of the literature in dental education
Nevius, A. M., Stellrecht, E. M., Schvaneveldt, N., & Dragan, I. F. (2020) · Journal of Dental Education · doi:10.1002/jdd.12140 · Cited by 3
Rodgers, J. B., & Ritskes-Hoitinga, M. J. (2021) · Laboratory animal science and medicine · doi:10.1007/978-3-030-66147-2_10 · Cited by 1
Short Review on srBERT: Automatic Article Classification Model for Systematic Review Using BERT
Choe, S., Aum, S., & Kim, J. H. (2022) · Asian Journal of Complementary and Alternative Medicine · doi:10.53043/2347-3894.acam90025 · Cited by 2
“However, due to the time-consuming and labor-intensive process for SRs, requiring an average of 67.3 weeks from protocol to publication [7], most SRs are insufficient in reflecting the latest research findings [8].”
InfluentialThe Use of Evidence Synthesis in the Context of Healthcare: A Literature Review Primer
Hariharan, J. A. (2023) · Undergraduate Research in Natural and Clinical Science and Technology (URNCST) Journal · doi:10.26685/urncst.431 · Cited by 1
Rapid Evidence Synthesis To Enable Innovation And Adoption in Health and Social CarePreprint
Norman, G., Wilson, P. M., Dumville, J. C., Bower, P., & Cullum, N. A. (2021) · Research Square · doi:10.21203/rs.3.rs-1135135/v1 · Cited by 1
Scaccia, J., & Scott, V. C. (2020) · Research Square · doi:10.21203/rs.3.rs-113353/v1 · Cited by 1
Gloves for COVID-19: A living systematic reviewPreprint
Ferrer, M. B. M., Ortiz-Muñoz, L. E., Duarte-Anselmi, G., Riquelme-Uribe, D., & Gabriel Rada, G. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/uz4rs · Cited by 1
Kim, J. S. M., Pollock, M., Kaunelis, D., & Weeks, L. (2021) · Research Square · doi:10.21203/rs.3.rs-688995/v1 · Cited by 1
Bright Light Therapy for Mental and Behavioral Illness: A Systematic Umbrella ReviewPreprint
Reis, D. J., Hoffberg, A. S., Stearns‐Yoder, K. A., & Bahraini, N. H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4130004 · Cited by 1
Commentary: Systematic reviews and observational epidemiology: The more things change…
LaKind, J. S., Burns, C. J., & Mattison, D. R. (2022) · Global Epidemiology · doi:10.1016/j.gloepi.2022.100088 · Cited by 1
Fatal flaws in systematic review conduct, and how to fix them – A commentary to Rao. et al. (2022)Preprint
Haddaway, N., & Vicente‐Vicente, J. L. (2022) · doi:10.31219/osf.io/8vbtw · Cited by 1
Muller, A. E., Berg, R. C., Meneses-Echavez, J. F., Ames, H. M. R., Borge, T. C., Jardim, P. S. J., Cooper, C., & Rose, C. J. (2023) · Research Square · doi:10.21203/rs.3.rs-1733027/v2 · Cited by 1
Zürrer, W. E., Cannon, A. E., Ewing, E., Rosso, M., Reich, D. S., & Ineichen, B. V. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.02.24.529867 · Cited by 3
“Despite the importance of systematic reviews, the process of manual evidence synthesis is highly labo72 rious (9).”
BackgroundSystematic Review using a Spiral approach with Machine LearningPreprint
Saeidmehr, A., Steel, P., & Samavati, F. F. (2023) · Research Square · doi:10.21203/rs.3.rs-2497596/v1 · Cited by 3
Lê, M., Winkler, J., & Neilson, C. J. (2023) · doi:10.31219/osf.io/e573s · Cited by 1
Meneses-Echavez, J. F., Muller, A. E., Berg, R. C., Ames, H. M. R., Borge, T. C., Jardim, P. S. J., Cooper, C., & Rose, C. J. (2023) · Research Square · doi:10.21203/rs.3.rs-3415812/v1 · Cited by 1
Oami, T., Okada, Y., & Nakada, T. (2023) · medRxiv · doi:10.1101/2023.12.29.23300652 · Cited by 1
Koh, Z. H., Zarnegar, A., Skues, J., & Murray, G. (2024) · doi:10.31234/osf.io/e25tn · Cited by 1
Oami, T., Okada, Y., & Nakada, T. (2024) · medRxiv · doi:10.1101/2024.05.22.24307740 · Cited by 2
Boesen, K., Hemkens, L. G., Janiaud, P., & Hirt, J. (2024) · medRxiv · doi:10.1101/2024.11.18.24317477 · Cited by 1
PharmD, L. T., Trampoukis, C., & Polymenakos, K. (2025) · medRxiv · doi:10.1101/2025.07.16.25331632 · Cited by 1
Fagerberg, P., Sallander, O., Patil, K. V., Berg, A., Nyman, A., Borg, N., & Lindén, T. (2025) · medRxiv · doi:10.1101/2025.11.03.25339455 · Cited by 3
Gartlehner, G., Banda, S., Callaghan, M., Chase, J. D., Dobrescu, A. I., Eisele‐Metzger, A., Flemyng, E., Gardner, S., Griebler, U., Helfer, B., et al. (2026) · medRxiv · doi:10.64898/2026.04.13.26350802 · Cited by 1
Booth, A., & Jones-Diette, J. S. (2018) · Springer eBooks · doi:10.1007/978-3-319-78966-8_6
Méta-analyse : comment faire la différence ?
Putman, S., Maisonneuve, H., Duhamel, A., & Clavert, P. (2017) · Revue de Chirurgie Orthopédique et Traumatologique · doi:10.1016/j.rcot.2017.09.404
Ninot, G., Amadori, F., Maitre, J., et al. (2018) · HEGEL - HEpato-GastroEntérologie Libérale · doi:10.4267/2042/65113
“Dans un troisième temps, la revue systématique ou la méta-analyse est publiée, en espérant que les délais de reviewing ne soient pas trop longs, car cela rendrait le travail obsolète au regard de l’accélération du nombre d’études interventionnelles publiées sur les INM et l’augmentation du nombre de revues [33].”
BackgroundMitchell, A., Price, M., & Cipriano, G. C. (2021) · medRxiv · doi:10.1101/2021.06.04.21258310
Systematic review reporting: how can we do better?
Stern, C. (2018) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2017-003959
Tagging Assistant for Scientific Articles
Nasar, Z., Jaffry, S. W., & Malik, M. K. (2019) · Communications in computer and information science · doi:10.1007/978-981-13-6052-7_30
Systematic reviews and meta-analyses: Valuable pieces of the clinical decision-making puzzle
Szekeres, M., & Valdes, K. A. (2019) · Journal of Hand Therapy · doi:10.1016/j.jht.2019.01.003
Seuring, T. (2020) · Springer Reference Pflege, Therapie, Gesundheit · doi:10.1007/978-3-662-54179-1_62-1
Begert, D., Granek, J., Irwin, B., & Brogly, C. (2020) · Relevé des maladies transmissibles au Canada · doi:10.14745/ccdr.v46i06a04f
McDonald, S. J. (2020) · Journal of Health Information and Libraries Australasia · doi:10.55999/johila.v1i2.29 · Cited by 2
Murgatroyd, P. (2020) · Journal of Health Information and Libraries Australasia · doi:10.55999/johila.v1i2.24
Rapid Reviews – anything goes?
Fangmeyer, M., & Toromanova, A. (2020) · Pflege · doi:10.1024/1012-5302/a000748
Minh, L. H. N., Le, H., Tawfik, G. M., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-617877/v1
COVID-19 LITERATURE TREND AND TOPICS ANALYSES USING INTELLIGENT TEXT MINING
(2021) · Issues in Information Systems · doi:10.48009/4_iis_2021_320-329
Accelerating your research career with open sciencePreprint
Norris, E. (2021) · doi:10.31234/osf.io/v743r
Fangmeyer, M. (2022) · PRO CARE · doi:10.1007/s00735-022-1523-x
Muller, A. E., Berg, R. C., Meneses-Echavez, J. F., Ames, H. M. R., Borge, T. C., Jardim, P. S. J., Cooper, C., & Rose, C. J. (2022) · Research Square · doi:10.21203/rs.3.rs-1733027/v1
Rapid evidence synthesis to enable innovation and adoption in health and social carePreprint
Norman, G., Wilson, P. M., Dumville, J. C., Bower, P., & Cullum, N. A. (2022) · Research Square · doi:10.21203/rs.3.rs-1135135/v2
Flaris, A. N., Carnabatu, C. J., Smith, A., et al. (2022) · Journal of surgical education · doi:10.1016/j.jsurg.2022.07.010
Strategies for conducting reviews
Oermann, M. H. (2022) · Nurse author & editor · doi:10.1111/nae2.12043
Oami, T., Okada, Y., Fukuda, T., Sakuraya, M., Nakada, T., & Shime, N. (2022) · medRxiv · doi:10.1101/2022.11.17.22282374
“evidence among the several components of developing clinical practice guidelines [1].”
BackgroundSeuring, T. (2022) · Springer Reference Pflege, Therapie, Gesundheit · doi:10.1007/978-3-662-65219-0_62 · Cited by 1
What does the evidence say? Automatic information extraction from medical trial reports
Nye, B. (2022) · Digital Repository Service (Northeastern University) · doi:10.17760/d20467219
Responding to COVID-19 pandemic at the local level: lessons from Yemen
Ghouth, A. S. B., & Mahmoud, N. (2023) · Eastern Mediterranean Health Journal · doi:10.26719/emhj.23.036
Lee, E. W., & Ho, J. C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-28244-7_35 · Cited by 2
West, R., Bonin, F., Thomas, J., Wright, A. J., Aonghusa, P. M., Gleize, M., Hou, Y., O’Mara-Eves, A., Hastings, J., Johnston, M., et al. (2023) · doi:10.31234/osf.io/wzn2b
Zürrer, W. E., Cannon, A. E., Ewing, E., Brüschweiler, D., Bugajska, J., Hild, B. F., Rosso, M., Reich, D. S., & Ineichen, B. V. (2023) · Research Square · doi:10.21203/rs.3.rs-2841635/v1
Patterson, P. D., & Yealy, D. M. (2023) · Resuscitation · doi:10.1016/j.resuscitation.2023.109815
Otte, W. M., van IJzendoorn, D. G. P., Habets, P. C., & Vinkers, C. H. (2023) · medRxiv · doi:10.1101/2023.09.06.23295135
Qualité en revue systématique : apport du documentaliste
Giroudon, C., Armoiry, X., & Fieux, M. (2023) · I2D - Information données & documents · doi:10.3917/i2d.231.0114
Azman, A. N. S. K., & Elgharbawy, A. A. M. (2023) · IIUM Medical Journal Malaysia · doi:10.31436/imjm.v22i4.2263
de Oliveira, I. B. D. (2023) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.9.2023.tde-13112023-164639
Adibi, S. (2024) · doi:10.2196/preprints.62784 · Cited by 2
Comparison of large language models for citation screening: A protocol for a prospective studyPreprint
Oami, T., Okada, Y., & Nakada, T. (2024) · medRxiv · doi:10.1101/2024.06.26.24309513
Burgos, M. A., Ivaldi, D., Oltra, G. V., Liquitay, C. M. E., & Garegnani, L. (2024) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70002 · Cited by 1
“We found a longer time to publication than that reported by Borah et al. in which a median of 1.4 years was estimated until the publication of an SR registered in PROSPERO [24].”
InfluentialXia, Z., Ye, J., Hu, B., Qiang, Q., & Debnath, R. (2024) · Research Square · doi:10.21203/rs.3.rs-5063165/v1 · Cited by 1
Pussegoda, K., Israr, I., Baumeister, A., Corrin, T., Sterian, M., Qamar, M., Samra, A., & Waddell, L. A. (2024) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70005 · Cited by 1
Wie wir schnelle Evidenzsynthesen generieren und adaptieren
Pieper, D., & Mathes, T. (2024) · Public Health Forum · doi:10.1515/pubhef-2024-0082
Sercombe, J., Bryant, Z., & Wilson, J. (2024) · doi:10.2196/preprints.68666
Next Generation Evidence: High-Precision Information Retrieval for Rapid Clinical Guideline UpdatesPreprint
Borchert, F., Wullenweber, P., Oeser, A., Kreuzberger, N., Karge, T., Langer, T. G., Skoetz, N., Wieler, L. H., Schapranow, M.-P., & Bert Arnrich, A. (2024) · medRxiv · doi:10.1101/2024.12.02.24318184
“Conducting a systematic review can take several years, whilst at the same time, reviews are prone to become outdated as new evidence is published [34, 35].”
Assessment of publication time in Campbell Systematic Reviews : A cross-sectional survey
Pan, B., Ge, L., Wang, X., Ma, N., Wei, Z., Honghao, L., Hou, L., & Yang, K. (2024) · Campbell Systematic Reviews · doi:10.1002/cl2.70011
Evaluating the Reliability of a Custom GPT in Full-Text Screening of a Systematic ReviewPreprint
Davis, R. C., List, S. S., Chappell, K. G., Madar, A., Henjum, S., & Heen, E. (2025) · medRxiv · doi:10.1101/2025.02.04.25321655
Exploring the Impact of Unsupervised Clustering Methods in Systematic Literature Reviews
Bolger, E., & Caballero, M. D. (2025) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3641555.3705184
Harrison, T., Hu, D., Jia, H., Tan, S. H., Chen, F., Zhang, Z., Lu, Q., Wang, J., Huang, M., Prokop, L. J., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5137601 · Cited by 2
Carrillo, B., Rubinos-Cuadrado, M., Parellada-Martin, J., Palacios-López, A., Carrillo-Rubinos, B., Canillas, F., Cortés, J. J. B., & Gómez‐Pavón, J. (2025) · doi:10.2196/preprints.75215
Extracting Health Evidence Information from Biomedical Literature using Large Language Models
Shahid, M. A., Afzal, M., & Şeker, H. (2024) · IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT) · doi:10.1109/bdcat63179.2024.00035 · Cited by 1
“An analysis by [9] found that SRs take an average of 67.3 weeks (16.8 months) and involve about five people.”
InfluentialAhern, E., Adedeji, T., Whiston, A., Dillon, S., & Lynn, F. A. (2025) · HRB Open Research · doi:10.12688/hrbopenres.14129.1
“However, systematic reviews require time and significant human resources for completion due to their comprehensive and rigorous approach to identifying and synthesising all relevant literature in a given topic area (Borah et al ., 2017).”
Carrillo, B., Rubinos-Cuadrado, M., Parellada-Martin, J., Palacios-López, A., Carrillo-Rubinos, B., Canillas, F., Cortés, J. J. B., & Gómez‐Pavón, J. (2025) · JMIR Formative Research · doi:10.2196/75215
“This is also well below the average time frames reported for SRs/MAs, which commonly take 1-2 years [49], or for accelerated alternatives such as rapid reviews, which range from 5 to 12 weeks [50], and even the Two-Week SR approach, which targets completion in 11 working days [51].”
Zary, N. (2025) · Preprints.org · doi:10.20944/preprints202506.0749.v1
Oh-Young, C., Buchter, J., Morgan, C. W., & Clark, C. (2025) · Remedial and Special Education · doi:10.1177/07419325251352181
Artificial intelligence tools for automating evidence synthesis: A scoping review (Preprint)Preprint
Harasgama, S., Pearce, H., Appel, C., Loftus, L., Painter, H., Kuhn, I. L., Karpusheff, J., Ceesay, A., & Ford, J. A. (2025) · doi:10.2196/preprints.81597
Motahari-Nezhad, H., & CheshmehSohrabi, M. (2025) · Research Square · doi:10.21203/rs.3.rs-7265470/v1 · Cited by 1
Ai-Assisted Versus Human Literature Identification: A Comparative AnalysisPreprint
O’Rourke, J., Byrne, M. D., & Schroers, G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5378590
MetaMind: A Multi-Agent Transformer-Driven Framework for Automated Network Meta-AnalysesPreprint
Livieratos, A., Kudela, M., Zhao, Y., et al. (2025) · medRxiv · doi:10.1101/2025.08.04.25332893
Nielsen, C. S., Soetikno, B. T., Pollreisz, A., & Ting, D. S. W. (2025) · Current Opinion in Ophthalmology · doi:10.1097/icu.0000000000001173
Teperikidis, E., Trampoukis, C., & Polymenakos, K. (2025) · Journal of Cardiovascular Pharmacology · doi:10.1097/fjc.0000000000001768 · Cited by 3
Raj, G. M. (2025) · Introduction to Basics of Pharmacology and Toxicology · doi:10.1007/978-981-95-1920-0_4
Ding, Y., Jiang, X., & Akinseloyin, O. (2025) · medRxiv · doi:10.1101/2025.11.08.25339805 · Cited by 1
“For example, the COVID-NMA project maintains a living synthesis of evidence on the effectiveness of interventions for COVID-19 prevention and treatment [2].”
How large language models can help us write a systematic review
Zahavi, I., & Einav, S. (2025) · Intensive Care Medicine · doi:10.1007/s00134-025-08226-z · Cited by 1
Han, H. W., Kim, J. H., Chio, J., Shim, S. R., Lee, J., & Lee, M. (2025) · doi:10.2196/preprints.87065
User experience and adoption of automation and AI for evidence synthesis: a scoping review protocol
Valenzuela, C., Stern, C., & Aromataris, E. (2025) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00236
Do SLM agents screen papers as well as LLMs?
Filho, J. G. M. D. F., & Fernandes, S. R. (2025) · Anais do XXII Encontro Nacional de Inteligência Artificial e Computacional (ENIAC 2025) · doi:10.5753/eniac.2025.13929 · Cited by 2
“A RSL ´e um processo inerentemente complexo e que demanda muitos recursos humanos e de tempo [Borah et al. 2017].”
Put, V., Kindermans, H. P. J., Hecke, A. V., Cummings, G. G., & Vlaeyen, E. (2025) · Systematic Reviews · doi:10.1186/s13643-025-02939-4 · Cited by 1
“For instance, an analysis of the International Prospective Register of Systematic Reviews (PROSPERO) found that it takes a median of 65.8 weeks from protocol registration to publication [25], and as many as 23% of systematic reviews may require updating within just 2 years of publishing [26].”
Influential
Metadata
- Authors
- Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A.
- Affiliations
- University of Alabama at Birmingham (US)
- Corresponding author
- Kaiser, Kathryn A
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-02
- Volume
- 7
- Issue
- 2
- Pages
- e012545
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5337708
- OpenAlex
- W2593758073
- Cited by
- 737
- References
- 29
- Citations by year
- 2026: 114 · 2025: 129 · 2024: 105 · 2023: 76 · 2022: 71 · 2021: 80 · 2020: 87 · 2019: 42 · 2018: 24 · 2017: 9
- FWCI
- 10.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- IUScholarWorks Open (Indiana University) (submittedVersion, cc-by-nc)
- HighWire Press Open Archive (submittedVersion)
- Funders
- University of Alabama at Birmingham (P30DK056336)
- University of Alabama (P30DK056336)
- National Institutes of Health
- National Institute of General Medical Sciences (K12GM088010)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK056336)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- systematic reviews, time to publication, research workforce, medical interventions, research resource allocation
- MeSH terms
- Workforce, Humans, Publishing, Registries, Review Literature as Topic, Task Performance and Analysis, Databases, Bibliographic, Information Storage and Retrieval, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.