Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry
Open accessThe DOI matches its Crossref record; 26 of the 29 references it cites were found in a registry or an index; 2 of the 3 sources its claims cite were checked for support.
Abstract
OBJECTIVES: To summarise logistical aspects of recently completed systematic reviews that were registered in the International Prospective Register of Systematic Reviews (PROSPERO) registry to quantify the time and resources required to complete such projects. DESIGN: Meta-analysis. DATA SOURCES AND STUDY SELECTION: All of the 195 registered and completed reviews (status from the PROSPERO registry) with associated publications at the time of our search (1 July 2014). DATA EXTRACTION: All authors extracted data using registry entries and publication information related to the data sources used, the number of initially retrieved citations, the final number of included studies, the time between registration date to publication date and number of authors involved for completion of each publication. Information related to funding and geographical location was also recorded when reported. RESULTS: The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42). The number of studies found in the literature searches ranged from 27 to 92 020; the mean yield rate of included studies was 2.94% (IQR=2.5); and the mean number of authors per review was 5, SD=3. Funded reviews took significantly longer to complete and publish (mean=42 vs 26 weeks) and involved more authors and team members (mean=6.8 vs 4.8 people) than those that did not report funding (both p<0.001). CONCLUSIONS: Systematic reviews presently take much time and require large amounts of human resources. In the light of the ever-increasing volume of published studies, application of existing computing and informatics technology should be applied to decrease this time and resource burden. We discuss recently published guidelines that provide a framework to make finding and accessing relevant literature less burdensome.
Overview
CoChat Summary
## TL;DR
Using 195 completed PROSPERO-registered systematic reviews of medical interventions, the authors estimated that reviews took a mean of 67.3 weeks to complete and publish and involved a mean of 5 authors per review. They conclude that systematic reviews are time- and labor-intensive, with funded reviews taking longer and involving more people than unfunded reviews.
## Key findings
- Across 195 completed reviews, the mean estimated time from registered project start to publication was 67.3 weeks (SD=31.0; range 6–186 weeks).
- The mean number of authors/team members was 5 (SD=3), and the mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).
- Literature searches were highly variable, with the number of studies found ranging from 27 to 92,020.
- Reviews that reported funding took longer and involved more people than those that did not report funding: 42 vs 26 weeks and 6.8 vs 4.8 people, both p<0.001.
## Methods
- Meta-analysis of PROSPERO registry records linked to completed review publications, using a sample of 195 registered and completed reviews with associated publications identified on 1 July 2014.
- Data were extracted from registry entries and publications on timing, authors/team members, funding, search sources, initial citations, and final included studies; the sample comprised 197 literature reviews from the 195 publications.
- Main analyses were descriptive summaries of means, ranges, and yield rates, plus ANOVA to compare funded vs unfunded reviews.
## Limitations
- The paper states that the study is limited by incomplete reporting in both the registry and the published articles, and that registry and publication data were cross-checked only where available.
- The authors state that the true project start date was difficult to capture, so their time estimates may be conservative and may underestimate time from the very first review activities.
- The paper notes that the data are highly skewed, making prediction of timelines statistically unsound; this is an evident limitation of the analysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
1 Valid · 1 Not valid · 1 Not checked · 23 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean number of authors per review was 5, SD=3.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean estimated time to complete the project and publish the review was 67.3 weeks (IQR=42).”
- Also stated in: § Results · plain
“The mean project length (using the registered project start date to the review's publication date) was 67.3 weeks (SD=31.0; range 6–186 weeks).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the mean yield rate of included studies was 2.94% (IQR=2.5);”
- Also stated in: § Results · plain
“The mean merged yield rate was 2.94% (SD=6.49; range 0–64.71%).”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plainn = 190- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reviews that reported funding took longer to complete and included more authors/team members; this difference was not seen when we considered only whether specific authors were funded.”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of studies found in the literature searches ranged from 27 to 92 020;”
§ Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
9 more claims
Create a free account to see all 26 claims and every source verdict.
- Probably not a substantial claim. 11
- It may state two separate claims as one. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Typically, only a small fraction of the records belong to the relevant class, making title and abstract screening an important bottleneck in systematic reviewing process 25 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“requiring a median of five researchers and around 40 weeks of work to reach submission [ 3 , 4 ]”
From Reducing systematic review burden using Deduklick: a novel, automated, reliable, and explainable deduplication algorithm to foster medical research (2022) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“typically taking over 16 months and costing upwards of $100,000 to complete 1,2 .”
From Automation of Systematic Reviews with Large Language Models (2025) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLMs can automate critical tasks for SLRs, including screening abstracts and full texts, assessing risk of bias and extracting data for use in network meta-analyses with high accuracy, all while significantly reducing the time and costs required by using human review [2, 4–7].”
From Automated Mass Extraction of Over 680,000 PICOs from Clinical Study Abstracts Using Generative AI: A Proof-of-Concept Study. (2024) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The HTA process is very labour and resource intensive, requiring a large team of experts in the field of health economic outcomes research (HEOR), including SLR analysts, statisticians and economic modellers [5, 8].”
From Artificial Intelligence to Automate Network Meta-Analyses: Four Case Studies to Evaluate the Potential Application of Large Language Models (2024) · cites this paper as [8]
Experimental — accuracy not yet measured
18 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 3×
“…clinical trials could be a starting point for testing the use of indexing systems that employ a Population, Intervention, Comparisons, Outcomes, Study Design (PICOS) 15 structure of coding metadata for clinical trials in order to make the scienti fi c literature become a truly searchable database.”
BackgroundInfluentialThe FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“1 Since the body of primary literature has increased, conducting systematic reviews and meta-analyses has become a necessity to more accurately and comprehensively present accumulated knowledge to scienti fi c, clinical and general audiences.”
BackgroundPROSPERO: an international prospective register of systematic reviews
Wright, K. E. (2014) · Cited by 568
(1965) · Nature · doi:10.1038/205236a0 · Cited by 560
Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram
Stovold, E., Beecher, D., Foxlee, R., & Noel-Storr, A. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-54 · Cited by 356
Cited by
Items 201–300 of 671
Oami, T., Okada, Y., Sakuraya, M., Fukuda, T., Shime, N., & Nakada, T. (2023) · Journal of Epidemiology · doi:10.2188/jea.je20230227 · Cited by 18
Giunti, G., & Doherty, C. P. (2024) · JMIR Medical Education · doi:10.2196/48949 · Cited by 22
Zhang, G., Zhou, Y., Hu, Y., Xu, H., Weng, C., & Peng, Y. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae065 · Cited by 17
Lee, K., Paek, H., Huang, L., Hilton, C. B., Datta, S., Higashi, J., Ofoegbu, N., Wang, J., Rubinstein, S. M., Cowan, A. J., et al. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101589 · Cited by 30
“On average, conducting a systematic literature review takes 17 months, with a range from 12 to 24 months [33], and the data extraction step, which is one of the most time-consuming parts of the process, could benefit significantly from automation.”
BackgroundCan AI review the scientific literature — and figure out what it all means?
Pearson, H. (2024) · Nature · doi:10.1038/d41586-024-03676-9 · Cited by 24
A Reproducibility and Generalizability Study of Large Language Models for Query Generation
Staudinger, M., Kusa, W., Piroi, F., Lipani, A., & Hanbury, A. (2024) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3673791.3698432 · Cited by 39
Working with a new kind of team: harnessing the wisdom of the crowd in trial identification
Noel-Storr, A. H. (2019) · EFSA Journal · doi:10.2903/j.efsa.2019.e170715 · Cited by 14
Is it time for computable evidence synthesis?
Dunn, A. G., & Bourgeois, F. T. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa035 · Cited by 16
Development and application of an outcome-centric approach for conducting overviews of reviews
Kho, M. E., Poitras, V. J., Janssen, I., Chaput, J., Saunders, T. J., Giangregorio, L., Tomasone, J. R., Ross‐White, A., & Ross, R. (2020) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/apnm-2020-0564 · Cited by 18
“The time and resources required to conduct a systematic review from protocol registration to publication is approximately 66 weeks, with trimmed mean of 63 papers reviewed in full text, yielding 15 included primary studies (Borah et al. 2017).”
BackgroundReason, T., Langham, J., & Gimblett, A. (2024) · Pharmaceutical Medicine · doi:10.1007/s40290-024-00539-6 · Cited by 16
“However, traditional SLRs are both time-consuming and costly to complete [4, 11, 32].”
BackgroundMethodSercombe, J., Bryant, Z., & Wilson, J. (2025) · JMIR Formative Research · doi:10.2196/68666 · Cited by 16
“However, this research methodology often takes up significant time, and therefore can be costly, and is subject to human error [3-5].”
InfluentialBannach‐Brown, A., Rackoll, T., Kaynak, N., Drude, N., Aquarius, R., Vojvodić, S., de Abreu, M. B., Menon, J. M. L., & Wever, K. E. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02146-0 · Cited by 19
“It has been approximated that a systematic review of health interventions takes approximately 1 year [10], and many of the underlying estimates also hold true for animal study reviews.”
BackgroundGavine, A. J., MacGillivray, S. A., Ross–Davie, M., Campbell, K., White, L., & Renfrew, M. J. (2018) · Humanities and Social Sciences Communications · doi:10.1057/s41599-017-0054-8 · Cited by 18
Menon, J. M. L., Ritskes-Hoitinga, M. J., Pound, P., & van Oort, E. (2021) · PLoS ONE · doi:10.1371/journal.pone.0260619 · Cited by 16
“On the other hand, researchers live in constant pursuit of delivering impactful results under great time pressure–leaving little space for conducting SRs, which are time-consuming [53].”
BackgroundEiring, Ø., Brurberg, K. G., Nytrøen, K., & Nylenna, M. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0829-z · Cited by 17
ASReview: Open Source Software for Efficient and Transparent Active Learning for Systematic Reviews.Preprint
van de Schoot, R., Bruin, J. D., Schram, R. D., Zahedi, P., de Boer, J., Weijdema, F., Kramer, B. M. R., Huijts, M., Hoogerwerf, M., Ferdinands, G., et al. (2020) · arXiv (Cornell University) · Cited by 21
Lee, K., Paek, H., Ofoegbu, N., Rube, S., Higashi, M. K., Dawoud, D., Xu, H., Shi, L., & Wang, X. (2025) · Value in Health · doi:10.1016/j.jval.2025.08.002 · Cited by 23
Rashid, M., Yi, C. S., Sathapanasiri, T., Udayachalerm, S., Boonpattharatthiti, K., Insuk, S., Veettil, S. K., Lai, N. M., Chaiyakunapruk, N., Dhippayom, T., et al. (2025) · Value in Health · doi:10.1016/j.jval.2025.07.001 · Cited by 26
Scotti, K. L., Young, S. M. N., Gainey, M. A., & Lan, H. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70046 · Cited by 37
“Evidence synthesis demands significant human effort, often requiring teams of experts months or even years to complete [23, 24].”
LAIGNELOT, F., Martin, G. L., OSSMAN, M., Pingeon, O., BOUBAKER, A., PICOVSCHI, E., Jia, K. I. M., Tannier, X., Cohen, J. F., & Dechartres, A. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112221 · Cited by 37
van der Mierden, S., Leenaars, C. H. C., Boyle, E. C., Ripoli, F. L., Gass, P., Durst, M., Goerlich-Jansson, V. C., Jirkof, P., Keubler, L. M., Talbot, S. R., et al. (2020) · ALTEX · doi:10.14573/altex.2004221 · Cited by 25
“Large systematic reviews take a long time to complete (e.g., Cochrane reviews take on average 67.3 weeks (Borah et al., 2017), and systematic (mapping) reviews of animal studies are no exception; refer to, e.g., two recently published reviews with search dates in December 2015”
BackgroundInfluentialGolinelli, D., Nuzzolese, A. G., Sanmarchi, F., Bulla, L., Mongiovì, M., Gangemi, A., & Rucci, P. (2022) · Information · doi:10.3390/info13030117 · Cited by 16
“Typically, only a small fraction of the records belongs to the relevant class, making title and abstract screening an important bottleneck in the systematic reviewing process (node 3, Figure 2) [33].”
BackgroundClyne, B., Hynes, L., Kirwan, C., McGeehan, M., Byrne, P., Killilea, M., Smith, S. M., Ryan, M., Collins, C., O’Neill, M., et al. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2021-111905 · Cited by 16
“…to support decision making, many organisations have moved from traditional systematic reviews (which can take an average of 15 months to complete 10 to rapid evidence products, such as rapid reviews (approach in which systematic review processes are streamlined or accelerated to meet decision…”
Assessment of Information Extraction Techniques, Models and Systems
Rahman, A., Musleh, D. A., Nabil, M., Alubaidan, H., Gollapalli, M. A. S., Krishnasamy, G., Almoqbil, D., Khan, M. A. A., Farooqui, M., Ahmed, M. I. B., et al. (2022) · Mathematical Modelling and Engineering Problems · doi:10.18280/mmep.090315 · Cited by 21
“In addition, an SLR with single/multiple human resource/s may take up to 186 weeks per [30].”
BackgroundMurton, M., Boulton, E., Cross, S., Khan, A., Kumar, S., Magri, G., Marris, C., Slater, D., Worthington, E., & Лунн, Е. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70058 · Cited by 20
“However, the rapidly growing volume of published literature (in biomedicine and life science, currently over 1 million articles are published each year) [5], not only means that SLRs are increasingly time ‐ and resource ‐ intensive [6, 7], but also that they can rapidly become outdated [8, 9].”
Scott, A. M., Glasziou, P., & Clark, J. M. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.03.007 · Cited by 15
Lebedev, G. S., Fartushniy, E., Fartushnyi, I. E., Shaderkin, I. A., Klimenko, H., Kozhin, P., Koshechkin, K. A., Ryabkov, I., Tarasov, V. V., Morozov, E., et al. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.09.195 · Cited by 18
“Modern estimates [9] show that the time from the publication of information to the release of a systematic review is on average 450 days.”
BackgroundCollaboration on evidence synthesis in Africa: a network study of growing research capacity
Pan, J., Zhong, Y., Young, S., & Niezink, N. M. D. (2021) · Health Research Policy and Systems · doi:10.1186/s12961-021-00774-2 · Cited by 16
“Since the average time to complete an evidence synthesis is over 1 year [33], these networks are a more realistic approximation of the collaborations among institutions than networks constructed based on a single year of publication data.”
BackgroundAjiji, P., Cottin, J., Picot, C., Uzunali, A., Ripoche, E., Cucherat, M., & Maison, P. (2022) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-022-03329-8 · Cited by 14
“5 months to complete a MA of 92,020 citations [5].”
BackgroundKusa, W., Hanbury, A., & Knoth, P. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-99736-6_39 · Cited by 19
“that conducting a full systematic review takes, on average, 67 weeks [4], although another past study reports that the median time to publication was 2.”
BackgroundData extraction methods for systematic review (semi)automation: A living review protocol
Schmidt, L., Olorisade, B. K., McGuinness, L. A., & Higgins, J. P. T. (2020) · F1000Research · doi:10.12688/f1000research.22781.1 · Cited by 24
“Although review size and the number of authors varied between the analysed reviews, the authors concluded that supporting the reviewing process with technological means is important in order to save thousands of personal working hours of trained and specialised staff 1 .”
Pap, R., McKeown, R., Lockwood, C. S., Stephenson, M., & Simpson, P. (2020) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-020-00762-5 · Cited by 19
Gómez-García, F. J., Ruano, J., Aguilar-Luque, M., Alcalde‐Mellado, P., Gay-Mimbrera, J., Hernández-Romero, J. L., Sanz-Cabanillas, J. L., Maestre-López, B., González-Padilla, M., Carmona-Fernández, P. J., et al. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0460-z · Cited by 14
“However, it is impractical to suggest that interested parties apply this same method to assess the methodological quality and the risk of bias of SRs, as it is a time-consuming process that requires systematic literature searching, abstract screening, and full, in-depth manuscript assessment; further, two or more eval…”
MethodArtificial Intelligence Software to Accelerate Screening for Living Systematic Reviews
Fuller‐Tyszkiewicz, M., Jones, A., Vasa, R., Vasa, R., Grbin, L., Macdonald, J. A., Deane, C., Samuel, D., Evans-Whipp, T., & Olsson, C. A. (2025) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-025-00519-5 · Cited by 22
“However, systematic reviews are labour intensive; it is estimated that the average, human-led review takes 67 weeks from registration to publication (Borah et al., 2017), and that at least one-quarter of reviews may require updating within 1–2 years of publication (Shojania et al., 2007).”
Optimal large language models to screen citations for systematic reviews
Oami, T., Okada, Y., & Nakada, T. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10014 · Cited by 29
Hilkenmeier, F., Pelzer, M., Stierle, C. M. G., & Fink‐Lamotte, J. (2025) · Social Science Computer Review · doi:10.1177/08944393251404052 · Cited by 22
Šuster, S., Baldwin, T., & Verspoor, K. M. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.04.006 · Cited by 17
Karabacak, M., Schüpper, A. J., Carr, M. T., Hickman, Z. L., & Margetis, K. D. (2023) · Neurosurgery · doi:10.1227/neu.0000000000002763 · Cited by 14
Pang, X., Saif‐Ur‐Rahman, K., Berhane, S., Yao, X., Kothari, K. U., Taneri, P. E., Thomas, J., & Devane, D. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111738 · Cited by 17
Addressing challenges with systematic review teams through effective communication: a case report
O’Dwyer, L., & Wafford, Q. E. (2021) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2021.1222 · Cited by 17
Rapid systematic reviews for synthesizing research on built environment
Lagisz, M., Vasilakopoulou, K., Bridge, C. E., Santamouris, M., & Nakagawa, S. (2022) · Environmental Development · doi:10.1016/j.envdev.2022.100730 · Cited by 16
Do it faster with PICOS: Generative AI-Assisted systematic review screening
Vallamchetla, S. K., Abdelkader, O., Elnaggar, A., Ramadan, D., Islam Shourav, M. M., Riaz, I. B., & Lin, M. P. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104860 · Cited by 13
Ruan, M., Fan, J., Liu, M., Meng, Z., Zhang, X., & Zhang, C. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02644-9 · Cited by 12
Bright light therapy for mental and behavioral illness: A systematic umbrella review
Reis, D. J., Hoffberg, A. S., Stearns‐Yoder, K. A., & Bahraini, N. H. (2022) · Chronobiology International · doi:10.1080/07420528.2022.2140669 · Cited by 16
“Also, any RCTs published within the few years prior to the end of the literature search date were likely to have been missed, given the length of time needed to both complete and update SRs (Bashir et al. 2018; Borah et al. 2017).”
BackgroundPMIDigest: Interactive Review of Large Collections of PubMed Entries to Distill Relevant Information
Novoa, J. A. R., Chagoyen, M., Benito, C., Moreno, F. J., & Pazos, F. (2023) · Genes · doi:10.3390/genes14040942 · Cited by 13
“Consequently, the generation of systematic reviews may take a considerable amount of time and require extensive effort [3].”
BackgroundSystematic review using a spiral approach with machine learning
Saeidmehr, A., Steel, P., & Samavati, F. F. (2024) · Systematic Reviews · doi:10.1186/s13643-023-02421-z · Cited by 19
“Academic search engines and databases remain poorly parsed or indexed, resulting in an exceedingly large number of false positives, often exceeding 30-to-1 [3, 4].”
BackgroundSong, Z., Hwang, G.-Y., Zhang, X., Huang, S., & Park, B.-K. (2025) · Scientific Reports · doi:10.1038/s41598-025-85715-7 · Cited by 25
Dennstädt, F., Windisch, P. Y., Filchenko, I., Zink, J., Putora, P. M., Shaheen, A., Gaio, R., Čihorić, N., Wosny, M., Aeppli, S., et al. (2025) · Oncology · doi:10.1159/000546946 · Cited by 16
“In an analysis of systematic reviews registered in the Prospective Register of Systematic Reviews (PROSPERO), the mean estimated time to complete a review was 67.3 weeks with a mean number of 5 researchers involved [2].”
InfluentialBERT for Complex Systematic Review Screening to Support the Future of Medical Research
Hasny, M., Vasile, A.-P., Gianni, M., Bannach‐Brown, A., Nasser, M., Mackay, M., donovan, D., Šorli, J., Domocos, I., Dulloo, M., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34344-5_21 · Cited by 12
Scaling Systematic Literature Reviews with Machine Learning Pipelines
Goldfarb-Tarrant, S., Robertson, A., Lazić, J., Tsouloufi, T. K., Donnison, L. M., & Smyth, K. (2020) · Workshop on Scholarly Document Processing (SDP) · doi:10.18653/v1/2020.sdp-1.21 · Cited by 14
“The stages of the process are time-consuming, but vary in how much physical and mental labour they require (Borah et al., 2017).”
BackgroundBannach‐Brown, A., Przybyła, P., Thomas, J., Rice, A. S. C., Ananiadou, S., Liao, J., & Macleod, M. R. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/255760 · Cited by 24
Brouwer, M., Hofstee, L., van den Brand, S. A. G. E., Teijema, J. J., Ferdinands, G., de Boer, J., Weijdema, F., Kramer, B., Wiers, R., Bockting, C., et al. (2022) · doi:10.31234/osf.io/j6nqz · Cited by 11
Kallmes, K. M., Thurnham, J., Sauca, M., Tarchand, R., Kallmes, K. R., & Holub, K. J. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70059 · Cited by 17
“Reviews have been estimated to cost over $141,000 in labor [37] and require 42 weeks of effort for teams of 7 [38]; in addition, work ‐ intensive review steps were identified as the primary blocker to living HTA [39].”
RetractedLi, L., Mathrani, A., & Sušnjak, T. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2025.10065 · Cited by 30
“With the explosion in the number of papers being published in academic databases, researchers have estimated that the average time to complete and publish a systematic review requiring five researchers is 67 weeks, with approximate cost of US$140,000 [11].”
Justification, rationale and methodological approaches to realist reviews
Pearsons, A., Neubeck, L., Hendriks, J., & Hanson, C. L. (2022) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvac068 · Cited by 15
Milella, F., & Bandini, S. (2024) · Intelligenza Artificiale · doi:10.3233/ia-240028 · Cited by 17
“Per-forming a systematic review is an expensive process that typically involves more than a year of effort from a group of researchers [12].”
Ofori-Boateng, R., Escobar, T. G. T., Aceves‐Martins, M., Wiratunga, N., & Moreno‐García, C. F. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102989 · Cited by 12
“Empirical evidence reports that an SR typically requires approximately 15 months to reach completion and publication [8].”
BackgroundFostering Scientific Meta-analyses with Knowledge Graphs: A Case-Study
Tiddi, I., Balliet, D. P., & ten Teije, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49461-2_17 · Cited by 12
Munn, Z., Brandt, L., Kuijpers, T., Whittington, C. J., Wiles, L., & Karge, T. (2020) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000226 · Cited by 11
“3 weeks shown in one study.(4) With the need to provide up-to-date and trustworthy recommendations in clinical practice, this”
BackgroundTsubota, T., Bollegala, D., Zhao, Y., Jin, Y., & Kozu, T. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104185 · Cited by 11
Begert, D., Granek, J., Irwin, B., & Brogly, C. (2020) · Canada Communicable Disease Report · doi:10.14745/ccdr.v46i06a04 · Cited by 14
“Publication times often exceed one year (3), and costs run into hundreds of thousands of dollars (4).”
BackgroundRemdesivir for the treatment of COVID-19: a living systematic review
Verdugo‐Paiva, F., Acuña, M. P., Solà, I., Gabriel Rada, G., & COVID-19 L·OVE Working Group (2020) · Medwave · doi:10.5867/medwave.2020.11.8080 · Cited by 12
Crowdsourcing citation-screening in a mixed-studies systematic review: a feasibility study
Noel-Storr, A. H., Redmond, P., Lamé, G., Liberati, E. G., Kelly, S., Miller, L., Dooley, G., Paterson, A., & Burt, J. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01271-4 · Cited by 15
“In part driven by the resources required to undertake citation-screening, reviews are typically time and labour intensive, taking an average of 67.3 weeks to complete [2] (Borah 2017).”
BackgroundInfluentialKim, J. S. M., Pollock, M., Kaunelis, D., & Weeks, L. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02071-7 · Cited by 16
“Given the exponential growth in the number of published SRs [14, 15] and high-resource requirements for completing new SRs [15, 16], conducting updates or overviews of existing SRs, instead of de novo SRs, may be considered by reviewers under the right circumstances.”
BackgroundCai, X., Geng, Y., Du, Y., Westerman, B. A., Wang, D., Ma, C., & García-Vallejo, J. J. (2023) · medRxiv · doi:10.1101/2023.09.06.23295072 · Cited by 11
“However, no study has investigated its application in compensating or substituting human effort spent on filtering records during meta-analysis, which is a severe issue because of the exponentially increased number of primary literature and systemic reviews.(11)”
BackgroundScotti, K. L., Jiao, C., Gainey, M. A., Bongiovanni, E. A., & Slayton, E. R. (2025) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2025.103054 · Cited by 23
Fütterer, T., Campos, D., Gfrörer, T., Lavelle-Hill, R. E., Murayama, K., & Scherer, R. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102849 · Cited by 18
Sousa, M. S. A., Peiris, S., Figueiró, M. F., Haby, M. M., Baraldi, A. C., Revéiz, L., & Souza, J. P. (2026) · Systematic Reviews · doi:10.1186/s13643-025-02842-y · Cited by 14
“…meta-analysis), summary of findings, discussion and conclusions, reference management, figures and tables, ES publication, dissemination and registration in specific databases — with the aim to reduce the workload, making the process more efficient, cost-effective and sustainable [10].”
Towards semantic-driven boolean query formalization for biomedical systematic literature reviews
Pourreza, M., & Ensan, F. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104928 · Cited by 17
Munn, Z., Pollock, D., Barker, T. H., Stone, J., Stern, C., Aromataris, E., Pearson, A., Straus, S., Khalil, H., Mustafa, R. A., et al. (2023) · Annals of Internal Medicine · doi:10.7326/m22-2603 · Cited by 10
Yoong, S. L., Jackson, J. K., Barnes, C., Pearson, N., Swindle, T., O'Reilly, S. L., Tabak, R. G., Belski, R., Brown, A., & Sutherland, R. (2021) · Public Health Nutrition · doi:10.1017/s1368980021000136 · Cited by 9
Self-citationMinh, L. H. N., Le, H., Tawfik, G. M., Makram, O. M., Tieu, T. M., Thang, T. L. L., Hung, D. T., Tran, V. P., Shahin, K. M., Abozaid, A. A., et al. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02210-8 · Cited by 10
“We selected this period because it represented the maximal time that a protocol would have the chance to be published (5 years) from the year in which we conducted this search method (26 July 2018), as estimated from the previous study [7].”
BackgroundMethodOfori-Boateng, R., Aceves‐Martins, M., Jayne, C., Wiratunga, N., & Moreno‐García, C. F. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.08.149 · Cited by 15
West, R., Bonin, F., Thomas, J., Wright, A. J., Aonghusa, P. M., Gleize, M., Hou, Y., O’Mara-Eves, A., Hastings, J., Johnston, M., et al. (2023) · Wellcome Open Research · doi:10.12688/wellcomeopenres.20000.1 · Cited by 22
Leenaars, C. H. C., de Vries, R. B. M., Reijmer, J., Holthaus, D., Visser, D. A., Heming, A., Elzinga, J., Kempkes, R. W. M., Beumer, W., Punt, C., et al. (2021) · Laboratory Animals · doi:10.1177/0023677221990688 · Cited by 10
Introduction to Systematic Reviews
Li, T., Saldanha, I. J., & Robinson, K. A. (2022) · Springer eBooks · doi:10.1007/978-3-319-52636-2_194 · Cited by 10
revtools: An R package to support article screening for evidence synthesisPreprint
Westgate, M. J. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/262881 · Cited by 24
Chan, G. C. K., He, E., Leung, J., & Verspoor, K. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.1 · Cited by 10
Teo, L., Elswyk, M. E. V., Lau, C. S., & Shanahan, C. J. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02374-3 · Cited by 13
“Systematic reviews are rigorous and time-and resource-intensive processes involving many steps and may often take years to complete [3, 4].”
BackgroundU.S. postsecondary students' health and academic outcomes: A comprehensive scoping review
Lederer, A. M., Oswalt, S. B., Parise, I. M., Rosenthal, M. N., & Horlick, R. (2024) · Preventive Medicine · doi:10.1016/j.ypmed.2024.108059 · Cited by 11
On the ethical and moral dimensions of using artificial intelligence for evidence synthesis
Bhaumik, S. (2025) · PLOS Global Public Health · doi:10.1371/journal.pgph.0004348 · Cited by 14
“[16] It is envisaged that AI systems by improving efficiency in the conduct of evidence synthesis, would lead to greater evidence uptake, and consequently improving health outcomes.”
Roy, K., Khandelwal, V., Lookingbill, V., Surana, H., Heckman, H., & Sheth, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i21.30577 · Cited by 15
Data Mining in Clinical Trial Text: Transformers for Classification and Question Answering Tasks
Schmidt, L., Weeds, J., & Higgins, J. (2020) · Proceedings of the 13th International Joint Conference on Biomedical Engineering Systems and Technologies · doi:10.5220/0008945700002513 · Cited by 9
Influenza A virus vaccine research conducted in swine from 1990 to May 2018: A scoping review
Keay, S., Poljak, Z., Klapwyk, M., O'Connor, A. M. C., Friendship, R. M., O’Sullivan, T. L., & Sargeant, J. M. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236062 · Cited by 10
Development and testing of Australian prehospital care quality indicators: study protocol
Pap, R., Lockwood, C. S., Stephenson, M., & Simpson, P. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038310 · Cited by 13
“28 It is anticipated that it will not be feasible to conduct systematic reviews for all QIs within the time and resources available for this project.”
Cell-based therapies for COVID-19: A living, systematic review
Gabriel Rada, G., Corbalán, J., & Rojas, P. (2020) · Medwave · doi:10.5867/medwave.2020.11.8078 · Cited by 9
The decisions and processes involved in a systematic search strategy: a hierarchical framework
Clark, J. M., Beller, E., Glasziou, P., & Sanders, S. (2021) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2021.1086 · Cited by 13
“The number of irrelevant studies found varies substantially across searches but can number in the tens of thousands [8, 9].”
BackgroundGuo, Q., Cheng, Y., Zhang, C., Yang, H., Chen, X., Wang, X., Liu, Y., Feng, K., Long, Y., Shao, Z., et al. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1581 · Cited by 13
“3 weeks from registration to publication.(3) A literature search of multiple databases combined with supplementary searches is the initial step when performing a SR with minimal bias.”
BackgroundUthman, O. A., Court, R. A., Enderby, J., Al-Khudairy, L., Nduka, C. U., Mistry, H., Meléndez‐Torres, G. J., Taylor‐Phillips, S., & Clarke, A. (2022) · Health Technology Assessment · doi:10.3310/udir6682 · Cited by 11
Comparison of protocols and registry entries to published reports for systematic reviews
Pieper, D., Allers, K., Mathes, T., Hoffmann, F., Klerings, I., Rombey, T., & Nussbaumer-Streit, B. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000053 · Cited by 8
Carev, M., Čivljak, M., Puljak, L., & Došenović, S. (2023) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2022-0129 · Cited by 9
The Past, Present, and Future of Psychotherapy Manuals: Protocol for a Scoping Review
Wislocki, K. E., Tran, M.-L. M., Petti, E., Hernandez-Ramos, R., Cenkner, D. P., Bridgwater, M. A., Naderi, G., Walker, L., & Zalta, A. K. (2023) · JMIR Research Protocols · doi:10.2196/47708 · Cited by 10
“Previous work has illustrated that the disparity in size between search results and the final sample is vast, with an average inclusion rate of ~3% of search results [18].”
Chen, F., Zhang, G., Fang, Y., Peng, Y., & Weng, C. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae326 · Cited by 12
Overview of artificial intelligence in hand surgery
Ryhänen, J., Wong, G. C., Anttila, T., & Chung, K. C. (2025) · Journal of Hand Surgery (European Volume) · doi:10.1177/17531934251322723 · Cited by 10
“…requiring extensive data such as systematic reviews, the traditional data collection process is known to be laborious, consuming over 1200 hours on average for article screening alone and taking more than a year to complete (Beller et al., 2013; Borah et al., 2017; Marshall and Wallace, 2019).”
Marques‐Cruz, M., Vieira, R. J., Martinho-Dias, D., Barbosa, J. P., Cardoso‐Fernandes, A., Franco-Pêgo, F., Perestrelo, P., Gil‐Mata, S., Taveira‐Gomes, T., Pêgo, J. M., et al. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2024.14 · Cited by 12
“44 This study also has several strengths.”
Use of Large Language Models to Extract Cost-Effectiveness Analysis Data: A Case Study
Gu, X., Zhang, H., Patil, D., Zafarí, Z., Slejko, J. F., & Onukwugha, E. (2025) · Value in Health · doi:10.1016/j.jval.2025.05.008 · Cited by 11
Williams, C., Sullivan, K. W., Kim, C., Winchester, L. J., & Fedewa, M. V. (2025) · Journal of Functional Morphology and Kinesiology · doi:10.3390/jfmk10020230 · Cited by 11
“However, the time elapsed from the conception of this study to the search for peer-reviewed studies for inclusion, the submission of the final manuscript, and eventual publication is well within a normal time frame [84].”
AI and Systematic Reviews: Can AI Tools Replace Librarians in the Systematic Search Process?
Park, S. (2025) · Science & Technology Libraries · doi:10.1080/0194262x.2025.2521519 · Cited by 13
“The increased popularity of systematic reviews, along with the recent embrace of AI-based technologies among researchers and the potential contribution of these tools to the systematic review, provides librarians with an opportunity to contribute to the research process by carefully assessing these…”
How Well Do ChatGPT and Claude Perform in Study Selection for Systematic Review in Obstetrics
Insuk, S., Boonpattharatthiti, K., Booncharoen, C., Chaipitak, P., Rashid, M., Veettil, S. K., Lai, N. M., Chaiyakunapruk, N., & Dhippayom, T. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02246-4 · Cited by 15
Moens, M., Nagels, G., Wake, N., & Goudman, L. (2025) · iScience · doi:10.1016/j.isci.2025.113559 · Cited by 13
“6 9 Consequently, it is plausible that many of these reviews may already be considered outdated and necessitate updating prior to publication.”
Metadata
- Authors
- Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A.
- Affiliations
- University of Alabama at Birmingham (US)
- Corresponding author
- Kaiser, Kathryn A
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-02
- Volume
- 7
- Issue
- 2
- Pages
- e012545
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5337708
- OpenAlex
- W2593758073
- Cited by
- 737
- References
- 29
- Citations by year
- 2026: 114 · 2025: 129 · 2024: 105 · 2023: 76 · 2022: 71 · 2021: 80 · 2020: 87 · 2019: 42 · 2018: 24 · 2017: 9
- FWCI
- 10.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- IUScholarWorks Open (Indiana University) (submittedVersion, cc-by-nc)
- HighWire Press Open Archive (submittedVersion)
- Funders
- University of Alabama at Birmingham (P30DK056336)
- University of Alabama (P30DK056336)
- National Institutes of Health
- National Institute of General Medical Sciences (K12GM088010)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK056336)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- systematic reviews, time to publication, research workforce, medical interventions, research resource allocation
- MeSH terms
- Workforce, Humans, Publishing, Registries, Review Literature as Topic, Task Performance and Analysis, Databases, Bibliographic, Information Storage and Retrieval, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.