Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
The current difficulties in keeping systematic reviews up to date leads to considerable inaccuracy, hampering the translation of knowledge into action. Incremental advances in conventional review updating are unlikely to lead to substantial improvements in review currency. A new approach is needed. We propose living systematic review as a contribution to evidence synthesis that combines currency with rigour to enhance the accuracy and utility of health evidence. Living systematic reviews are high quality, up-to-date online summaries of health research, updated as new research becomes available, and enabled by improved production efficiency and adherence to the norms of scholarly communication. Together with innovations in primary research reporting and the creation and use of evidence in health systems, living systematic review contributes to an emerging evidence ecosystem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“for a primary study, it takes 2.5 - 6.5 years before it is incorporated in an SLR study [7,8].”
From Automation of systematic literature reviews: A systematic literature review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Between 2014 (when the LSR approach first emerged 3 ) and 2019, the rate of publication of these systematic reviews was low; however, since 2019, there has been a rapid increase.”
From Extension of the PRISMA 2020 statement for living systematic reviews (PRISMA-LSR): checklist and explanation (2024) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“The most efficient use and application of the machine-learning technologies would be in the areas allowing automation of specific SR processes, in particular those involving time-consuming and resource-intensive tasks such as language translation [15], study selection [11, 16–18], data extraction [19] and risk of bias assessment [20].”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“Living systematic reviews are dynamic and constantly changing online-only evidence summaries that demand less intensive work over time compared to static and sporadically more resource-intensive conventional SRs.”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“The authors proposed to initiate living systematic reviews, which represent high-quality online evidence summaries, continuously updated as any new relevant evidence becomes available.”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [18]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Knowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407 · cited 1×
“The reasons for this gap are complex [2], but it is clear that synthesising the complex, incomplete, and at times conflicting findings of biomedical research into forms that can readily inform health decision making is an essential component of the bridge from ‘‘knowing’’ to ‘‘doing.”
BackgroundTrial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881 · cited 1×
“Statistical monitoring of metaanalyses using formal sequential methods can control the risk of spurious findings, while achieving pre-specified power to identify a pre-specified clinically relevant magnitude of effect [16,17].”
MethodCentral challenges facing the national clinical research enterprise
Sung, N. S., Crowley, W. F., Genel, M., Salber, P., Sandy, L., Sherwood, L. M., Johnson, S. B., Catanese, V., Tilson, H., Getz, K., et al. (2003) · JAMA · doi:10.1001/jama.289.10.1278 · Cited by 1,235
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Finding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 943
How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-4-200708210-00179 · Cited by 838 · cited 1×
“By 2 years post-publication 23% of SRs that have not been updated will have failed to incorporate new evidence that would substantively change conclusions about the effectiveness or harms of therapies [9].”
Background
Research works printed but not linked: 4
- 22. Elliott J (2012) Exploiting innovations in technology to improve the efficiency of review production. 20th Cochrane Colloquium. Auckland.
- 23. Ciapponi A, Glujovsky D (2012) Survey among Cochrane authors about early stages of systematic reviews. In: Proceedings of the 20th Cochrane Colloquium; 30 September–3 October 2012 Auckland, New Zealand
- 34. McGee R, Willis N, Jones A, Higgins G, Craig J, et al.. (2012) Factors associated with the timely completion of a Cochrane review. In: Proceedings of the 20th Cochrane Colloquium; 30 September–3 October 2012Auckland, New Zealand
- 38. Noel-Storr A, Struthers C, Huckvale C, Dooley G, McShane R (2012) ALOIS, ScreenToGo and the Cochrane Register of Studies: using mobile technology to engage and involve consumers in the work of the Cochrane Collaboration. In: Proceedings of the 20th Cochrane Colloquium; 30 September–3 October 2012Auckland, New Zealand.
Cited by
Items 201–300 of 591
Khamis, A. M., Kahale, L. A., Hernandez, H. P., Schünemann, H. J., & Akl, E. A. (2019) · F1000Research · doi:10.12688/f1000research.18005.2 · Cited by 26
(2015) · PubMed Central · Cited by 20
Is the ‘Evidence-Pyramid’ now dead?
Tugwell, P., & Knottnerus, J. A. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.10.001 · Cited by 23
Gondo, G., Shin, J.-H., Kunisawa, S., & Imanaka, Y. (2024) · Osteoporosis International · doi:10.1007/s00198-024-07269-0 · Cited by 24
“The gap between recommended evidence and clinical practice is referred to as the “evidence-practice gap” [17–19].”
Rombey, T., Lochner, V., Puljak, L., Könsgen, N., Mathes, T., & Pieper, D. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1409 · Cited by 20
“of studies identified from previous SR (n = 82) 7 (2-15)”
BackgroundInfluentialGarety, P. A., Ward, T., Emsley, R., Greenwood, K., Freeman, D. H., Fowler, D. G., Kuipers, E., Bebbington, P., Dunn, G., & Hardy, A. (2021) · Efficacy and Mechanism Evaluation · doi:10.3310/eme08110 · Cited by 23
Effect of Attentional Focus on Sprint Performance: A Meta-Analysis
Li, D., Zhang, L., Yue, X., Memmert, D., & Zhang, Y. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19106254 · Cited by 31
“As we know, a systematic review is an opportunity to narrow the evidence–practice gap [25], and a meta-analytic review is characterized by its comprehensiveness, quantified evidence, and guidance for practice [26].”
BackgroundElkins, M. R. (2017) · Journal of physiotherapy · doi:10.1016/j.jphys.2017.11.009 · Cited by 21
Knowledge Gaps in Placebo Research: With Special Reference to Neurobiology
Enck, P., Horing, B., Broelz, E. K., & Weimer, K. (2018) · International review of neurobiology · doi:10.1016/bs.irn.2018.07.018 · Cited by 20
A Visual Approach to Query Formulation for Systematic Search
Russell‐Rose, T., Chamberlain, J., & Shokraneh, F. (2019) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3295750.3298919 · Cited by 21
Living systematic review: new inputs and challenges
Vergara-Merino, L., Verdejo, C., Carrasco, C., & Vargas-Peirano, M. (2020) · Medwave · doi:10.5867/medwave.2020.11.8092 · Cited by 18
Kakudate, N., Yokoyama, Y., Sumida, F., Matsumoto, Y., Yamazaki, H., Touge, T., Fujikawa, Y., Gordan, V. V., & Gilbert, G. H. (2020) · Journal of Dentistry · doi:10.1016/j.jdent.2020.103469 · Cited by 20
“However, there has always been a gap between scientific evidence and actual clinical practice, which is referred to as the “evidence-practice gap (EPG)” [3].”
BackgroundMuller, H., Pachnanda, S., Pahl, F., & Rosenqvist, C. (2022) · International Conference on Applied Artificial Intelligence (ICAPAI) · doi:10.1109/icapai55158.2022.9801564 · Cited by 31
“Due to the immaturity of these solutions, ML is much rather used to expedite tasks, rather than automate them completely [4].”
InfluentialSmith, L. C. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24851 · Cited by 22
“According to Elliott et al. ( 2014), such reviews are high quality, up-to-date online summaries of health research, updated as new research becomes available, and enabled by improved production efficiency.”
BackgroundScreening Coverage Needed to Reduce Mortality from Prostate Cancer: A Living Systematic Review
Rahal, A. K., Badgett, R. G., & Hoffman, R. M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0153417 · Cited by 18
“Living systematic review have been proposed to improve the dissemination of medical evidence [8, 39].”
Surian, D., Dunn, A. G., Orenstein, L., Bashir, R., Coiera, E. W., & Bourgeois, F. T. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.01.008 · Cited by 17
“This suggests that the two could be used as complementary solutions as part of a pipeline of methods for automatically identifying trials that may be relevant to the update of a systematic review, or used to support updates of living systematic reviews [17].”
BackgroundMethodLiving network meta-analysis was feasible when considering the pace of evidence generation
Créquit, P., Martin-Montoya, T., Attiche, N., Trinquart, L., Vivot, A., & Ravaud, P. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.12.008 · Cited by 19
An efficient way to assess the effect of COVID-19 on mental health in the general population
Salanti, G., Cipriani, A., Furukawa, T. A., Peter, N. L., Tonia, T., Papakonstantinou, T., Holloway, A., & Leucht, S. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00067-5 · Cited by 17
Achieving a real‐time online monitoring system for conservation culturomics
Johnson, T. F., Cornford, R., Dove, S., Freeman, R., & Millard, J. W. (2023) · Conservation Biology · doi:10.1111/cobi.14096 · Cited by 17
“In the manner of living reviews (Elliott et al., 2014), updatable platforms that can provide a robust current account of human–nature interactions should be encouraged.”
BackgroundNow that we’re here, where are we? The JBI approach to evidence-based healthcare 20 years on
Jordan, Z., Munn, Z., Aromataris, E., & Lockwood, C. S. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000053 · Cited by 23
“Last year, Elliott et al.(11) suggested that ‘living systematic reviews’ may help to bridge the gap between evidence and practice.”
Backgroundon behalf of the Project Transform Team, Turner, T., developers, I., Green, S., Tovey, D. I., McDonald, S. J., Soares‐Weiser, K., Pestridge, C., & Elliott, J. H. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0542-3 · Cited by 20
“We are currently piloting an approach to produce living systematic reviews [7], supported by machine learning and citizen science approaches, and are exploring pilots focusing on supporting larger author teams and novel approaches to support participation in review production by authors in lowresource settings.”
MethodSelf-citationBragge, P., Allison, D. J., Mehta, S., Guy, S. D., & Loh, E. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.11.037 · Cited by 15
John, A. M., Eyles, E., McGuinness, L. A., Okolie, C., Olorisade, B. K., Schmidt, L., Webb, R. T., Arensman, E., Hawton, K. E., Kapur, N., et al. (2020) · F1000Research · doi:10.12688/f1000research.24274.1 · Cited by 23
“Living systematic reviews are high-quality, up-todate online summaries of research that are regularly updated, using efficient, often semi-automated, systems of production (Elliott et al., 2014).”
BackgroundSelf-citationTransforming evidence for policy: do we have the evidence generation house in order?
Stewart, R. J., Dayal, H., Langer, L., & van Rooyen, C. (2022) · Humanities and Social Sciences Communications · doi:10.1057/s41599-022-01132-5 · Cited by 19
Harder, R. (2024) · MethodsX · doi:10.1016/j.mex.2024.102601 · Cited by 24
“Evidence synthesis can be supported by machine learning algorithms, such as topic modelling, to provide substantial enhancement to the productivity of evidence synthesis [ 4 , 5 , 10 , 14 ].”
Luo, Y., Chaimani, A., Kataoka, Y., Ostinelli, E. G., Ogawa, Y., Cipriani, A., Salanti, G., & Furukawa, T. A. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-023222 · Cited by 18
“First, it has become increasingly known that a substantive amount of trials of antidepressants remain unpublished and were not included in contemporary SRs, a fact which most likely introduces publication bias into the results of SRs and thus undermines the credibility of guidelines.12 Second, it has been reported tha…”
BackgroundInfluentialHiggins, S., Katsipataki, M., Aguilera, A. B. V., Dobson, E., Gascoine, L., Rajab, T., Kalambouka, A., Reardon, J., Stafford, J., & Uwimpuhwe, G. (2022) · Review of Education · doi:10.1002/rev3.3327 · Cited by 27
Community engagement to support COVID-19 vaccine uptake: a living systematic review protocol
Gilmore, B., Gerlach, N., Lopes, C. A., Diallo, A. A., Bhattacharyya, S., de Claro, V., Ndejjo, R., Nyamupachitu-Mago, E., & Tchetchia, A. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-063057 · Cited by 21
How should patient decision aids for schizophrenia treatment be designed? - A scoping review
Müller, K., Schuster, F., Rodolico, A., Siafis, S., Leucht, S., & Hamann, J. (2023) · Schizophrenia Research · doi:10.1016/j.schres.2023.03.025 · Cited by 17
Fanshawe, T. R., Shaw, L., & Spence, G. T. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1238 · Cited by 17
Synnot, A., Bragge, P., Lunny, C., Menon, D. K., Clavisi, O., Pattuwage, L., Volovici, V., Mondello, S., Cnossen, M. C., Donoghue, E., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0198676 · Cited by 18
Self-citationEmergency remote teaching in higher education: Mapping the first global online semester (Pre-print)Preprint
Bond, M., Bedenlier, S., Marín, V. I., & Händel, M. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/gsdu7 · Cited by 21
Artificial Intelligence Software to Accelerate Screening for Living Systematic Reviews
Fuller‐Tyszkiewicz, M., Jones, A., Vasa, R., Vasa, R., Grbin, L., Macdonald, J. A., Deane, C., Samuel, D., Evans-Whipp, T., & Olsson, C. A. (2025) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-025-00519-5 · Cited by 22
The WFH Guidelines for the Management of Haemophilia: AAV Gene Therapy, 2025
Pierce, G. F., Ozelo, M. C., Mahlangu, J. N., Dunn, A. L., Beijlevelt, M., Bender, R., Carcao, M. D., Coffin, D., Grazzi, E. F., Foster, G. R., et al. (2025) · Haemophilia · doi:10.1111/hae.70113 · Cited by 24
“…following the Living Guidelines Model because it fits the following criteria: (1) the recommendations are a priority for decision-making; (2) the recommendations are likely to change as new evidence, practices or interventions emerge; and (3) the research evidence base is evolving [122, 123, 127].”
A call for researchers to join the META-MICROBLEEDS Consortium
Charidimou, A., Soo, Y. O. Y., Heo, J. H., & Srikanth, V. K. (2016) · The Lancet Neurology · doi:10.1016/s1474-4422(16)30124-7 · Cited by 15
Lange, T., Schwarzer, G., Datzmann, T., & Binder, H. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1486 · Cited by 39
Del-Águila-Mejía, J., Armon, S., Campbell, F., Colling, R. T., Chechlińska, M., Kowalewska, M., Pollán, M., Holdenrieder, S., Tan, P. H., Cree, I. A., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061240 · Cited by 15
Ramos, E., Egea, J., Lopez-Munoz, F. J., Gil‐Martín, E., & Romero, A. (2023) · Pharmaceutics · doi:10.3390/pharmaceutics15061616 · Cited by 18
“The described protocol is fully reproducible and allows for the inclusion of emerging information through newly updated or continually updated systematic reviews, which are also known as living systematic reviews [46].”
An Interactive Relevance Feedback Interface for Evidence-Based Health Care
Donoso-Guzmán, I., & Parra, D. (2018) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3172944.3172953 · Cited by 17
“Moreover, with the explosion of scientific knowledge being published, it is difficult for clinicians to stay updated on the latest best medical practices [12, 17].”
BackgroundKnowledge, Attitude and Practice of Brazilian Obstetricians Regarding Episiotomy
Cunha, C. M. P., Katz, L., Lemos, A., & Amorim, M. M. R. (2019) · Revista Brasileira Ginecologia e Obstetrícia · doi:10.1055/s-0039-3400314 · Cited by 15
Bougioukas, K. I., Pamporis, K., Vounzoulaki, E., Karagiannis, T., & Haidich, A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.11.003 · Cited by 16
Winters, M., Lyng, K. D., Holden, S., Lura, C. B., Welton, N. J., Caldwell, D. M., Vicenzino, B., Weir, A., & Rathleff, M. S. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-104360 · Cited by 15
Simons, D., Shahab, L., Brown, J., & Perski, O. (2021) · Qeios · doi:10.32388/ujr2aw.13 · Cited by 15
Hayden, J. A., Hayden, J. A., Ogilvie, R., Singh, S., Kashif, S., Hartvigsen, J., Maher, C. G., Furlan, A. D., Lasserson, T. J., Tugwell, P., et al. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.09.013 · Cited by 15
Automation of citation screening in pre-clinical systematic reviews
Liao, J., Ananiadou, S., Currie, L. G., Howard, B. E., Rice, A., Sena, S. E., Thomas, J., Varghese, A., & Macleod, M. R. (2018) · doi:10.1101/280131 · Cited by 13
Self-citationIannizzi, C., Akl, E. A., Kahale, L. A., Dorando, E., Aminat, A. M., Barker, J. M., McKenzie, J. E., Haddaway, N., Piechotta, V., & Skoetz, N. (2021) · F1000Research · doi:10.12688/f1000research.55108.1 · Cited by 15
“Due to continuous publishing of relevant primary studies in some areas, it is important to keep these SRs up-to-date.(1) One could achieve that goal by adopting the living systematic review (LSR) approach, which is based on an ongoing surveillance of the literature and continual updating.”
BackgroundTreatment of UTIs in Infants <2 Months: A Living Systematic Review
Nama, N., Donken, R., Pawliuk, C., Leache, L., Sadarangani, M., Carwana, M., & THE INSIGHTSCOPE TEAM (2021) · Hospital Pediatrics · doi:10.1542/hpeds.2021-005877 · Cited by 18
Time for a new global roadmap for supporting evidence into action
Kuchenmüller, T., Lavis, J. N., Kheirandish, M., Revéiz, L., Reinap, M., Okeibunor, J., Siswanto, S., Rashidian, A., Sieber, S., Moat, K. A., et al. (2022) · PLOS Global Public Health · doi:10.1371/journal.pgph.0000677 · Cited by 14
“Furthermore, the increased demand for evidence has led to a global push for innovative solutions such as the scaling-up of living evidence syntheses [2].”
BackgroundBolland, M. J., Avenell, A., & Grey, A. B. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0556-0 · Cited by 16
Khamis, A. M., Kahale, L. A., Pardo-Hernandez, H., Schünemann, H. J., & Akl, E. A. (2019) · F1000Research · doi:10.12688/f1000research.18005.1 · Cited by 14
Twitter-Based Journal Clubs: Additional Facts and Clarifications
Topf, J. M., Sparks, M. A., Iannuzzella, F., Lerma, E. V., Oates, T. M., Phelan, P. J., & Hiremath, S. S. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4639 · Cited by 14
“Referred to as a "living" systematic review, this concept has been encouraged to keep the literature relevant and to narrow the evidence-practice gap [3].”
Pope, J. E., Deer, T. R., Sayed, D., Antony, A. B., Bhandal, H. S., Calodney, A. K., Chakravarthy, K. V., Costandi, S. J., Diep, J., Durbhakula, S., et al. (2025) · Journal of Pain Research · doi:10.2147/jpr.s475527 · Cited by 14
Effect of Evidence‐Based Practice (EBP) Courses on MSN and DNP Students’ Use of EBP
Moore, E. R., Watters, R., & Wallston, K. A. (2019) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12369 · Cited by 13
Calanzani, N., Druce, P., Snudden, C. M., Milley, K. M., Boscott, R. A., Behiyat, D., Saji, S., Martínez-Gutiérrez, J., Oberoi, J., Funston, G., et al. (2020) · Advances in Therapy · doi:10.1007/s12325-020-01571-z · Cited by 14
Whittle, S., Glennon, V., & Buchbinder, R. (2023) · International Journal of Rheumatic Diseases · doi:10.1111/1756-185x.14926 · Cited by 13
Stay alive! What are living systematic reviews and what are their advantages and challenges?
Winters, M., de Vos, R., van Middelkoop, M., Rathleff, M. S., & Weir, A. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-103490 · Cited by 13
Simons, D., Shahab, L., Brown, J., & Perski, O. (2021) · Qeios · doi:10.32388/ujr2aw.15 · Cited by 14
(2022) · doi:10.1101/2022.01.20.22269581 · Cited by 13
“Methods 136 We conducted a living systematic review, a systematic review that provides an online summary of 137 findings and is updated when relevant new evidence becomes available [16].”
Living evidence and adaptive policy: perfect partners?
Turner, T., Lavis, J. N., Grimshaw, J., Green, S., & Elliott, J. H. (2023) · Health Research Policy and Systems · doi:10.1186/s12961-023-01085-4 · Cited by 18
“Here we focus on ‘living systematic reviews’, in which systematic, rigorous evidence syntheses are continually updated to reflect new relevant evidence as it becomes available [13].”
BackgroundSelf-citationZeraatkar, D., Ling, M., Kirsh, S., Jassal, T., Pitre, T., Chakraborty, S. P., Turner, T., Turkstra, L. S., McIntyre, R. S., Izcovich, A., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-086407 · Cited by 18
“50 51 This review will provide comprehensive, trustworthy and up- to-date summaries of the evidence addressing interventions for the management of long COVID.”
Self-citationAhuja, D., & Singh, S. (2022) · Current Opinion in Gastroenterology · doi:10.1097/mog.0000000000000854 · Cited by 13
“As more interventions are tested, either in placebocontrolled trials, and/or in head-to-head trials, living systematic reviews that are continually updated at predefined intervals, incorporate new evidence, as it becomes available [36].”
BackgroundA meta-analytic approach to evaluating the explanatory adequacy of theories
Cristià, A., Tsuji, S., & Bergmann, C. (2022) · Meta-Psychology · doi:10.15626/mp.2020.2741 · Cited by 13
Rytwinski, T., Cooke, S. J., Taylor, J. J., Roche, D. G., Smith, P. A., Mitchell, G. W., Smokorowski, K. E., Prior, K. A., & Bennett, J. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.145122 · Cited by 14
“One novel approach stemming from the healthcare field, that goes beyond simply updating the evidence base, is the concept of a living systematic review (Elliott et al., 2014).”
BackgroundGrewal, S., & Klassen, T. P. (2014) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2014.423 · Cited by 12
Planning a Cochrane Review of diagnostic test accuracy
Flemyng, E., Cumpston, M., Arévalo-Rodríguez, I., Chandler, J., & Deeks, J. J. (2023) · Wiley eBooks · doi:10.1002/9781119756194.ch1 · Cited by 16
Stachetti, T., Spodenkiewicz, M., Winer, A., Boukerrou, M., Jesson, J., & Gérardin, P. (2019) · Journal of Global Health Reports · doi:10.29392/joghr.3.e2019085 · Cited by 12
Living health technology assessments: how close to living reality?
Sarri, G., Forsythe, A., Elvidge, J., & Dawoud, D. (2023) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-112152 · Cited by 13
Kayiba, N. K., Tshibangu‐Kabamba, E., Rosas-Aguirre, Á. M., Kaku, N., Nakagama, Y., Kaneko, A., Mvumbi, D. M., Yobi, D. M., Devleesschauwer, B., Likwela, J. L., et al. (2023) · Tropical Medicine and Health · doi:10.1186/s41182-023-00551-7 · Cited by 11
“Therefore, this work and subsequent updates through an intended living systematic review process [49] have the potential to support a continuous monitoring of drug-resistant malaria through the country while supporting evidence-based public health decision making and identifying surveillance gaps…”
BackgroundStructured reviews for data and knowledge-driven research
Queralt-Rosiñach, N., Stupp, G. S., Li, T. S., Mayers, M., Hoatlin, M. E., Might, M., Good, B. M., & Su, A. I. (2020) · Database · doi:10.1093/database/baaa015 · Cited by 11
“This allows for the application of graph and artificial intelligence algorithms and tools and better promotes the FAIR principles (13,14).”
MethodGupta, T., Thakkar, P., Kalra, B., & Kannan, S. (2021) · Reviews in Medical Virology · doi:10.1002/rmv.2276 · Cited by 10
“guage restrictions was conducted on 25 September 2020 and later updated periodically till 28 February 2021 in accordance with international guidelines for living systematic reviews.(26)”
MethodA bibliometric review on development economics research in Vietnam from 2008 to 2020
Ho, M., Le, N.-T. B., Ho, T. M., & Vuong, Q. (2021) · Quality & Quantity · doi:10.1007/s11135-021-01258-9 · Cited by 16
Metzendorf, M., Weibel, S., Reis, S., & McDonald, S. J. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-112019 · Cited by 10
Mathews, C., Goga, A. E., Loveday, M., Zembe‐Mkabile, W., Daviaud, E., Siegfried, N., & Lewin, S. A. (2019) · South African Medical Journal · doi:10.7196/samj.2019.v109i11b.14245 · Cited by 12
“For HPSR evidence to inform and strengthen health systems, it needs to make its way through the related stages of the evidence ecosystem[16-18] (Fig.”
BackgroundMethodological quality and risk of bias of meta-analyses of pharmacy services: A systematic review
Bonetti, A. D. F., Tonin, F. S., Rocca, A. M. D., Lucchetta, R. C., Fernández-Llimós, F., & Pontarolo, R. (2020) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2020.12.011 · Cited by 15
Laying the foundations for success: co-creating sustainable marketing solutions
Kim, J., Rundle-Thiele, S. R., Knox, K., & Dietrich, T. (2021) · Journal of Strategic Marketing · doi:10.1080/0965254x.2021.1900341 · Cited by 14
“Valuable knowledge was gained through this step delivering a robust competition-check, however, given the urgency of the food waste (and other social) problems, methods like a Living Systematic review (Elliott et al., 2014) could be considered in future research to reduce the resourcing time.”
MethodThe time has come for living systematic reviews in autism research
Elsabbagh, M., Yusuf, A., Zeidan, J., Scorah, J., Fombonne, E. J., Durkin, M. S., Saxena, S., & Shih, A. J. (2022) · Autism Research · doi:10.1002/aur.2739 · Cited by 13
Revisiting Radiograph-Negative Ankle Injuries in Children: Is It a Fracture or a Sprain?
Gill, P. J., & Klassen, T. P. (2016) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2015.4147 · Cited by 11
Simons, D., Shahab, L., Brown, J., & Perski, O. (2020) · Qeios · doi:10.32388/ujr2aw.6 · Cited by 12
Interpretation of meta-analyses
Clephas, P. R. D., & Heesen, M. A. (2022) · Interventional Pain Medicine · doi:10.1016/j.inpm.2022.100120 · Cited by 17
“Another emerging type of meta-analysis is that of living systematic reviews [52], which incorporates up-coming data in regular, pre-de fi ned time-intervals.”
BackgroundA Living Database of HIV Implementation Research (LIVE Project): Protocol for Rapid Living Reviews
Eshun‐Wilson, I., Ford, N. P., Tourneau, N. L., Baral, S., Schwartz, S., Kemp, C. G., & Geng, E. (2022) · JMIR Research Protocols · doi:10.2196/37070 · Cited by 10
“This continuous emergence of new implementation research means that traditional methods for generating “static” systematic reviews that may take months or years to produce can quickly become obsolete [3,4].”
MethodKnafou, J., Haas, Q., Borissov, N., Counotte, M. J., Low, N. N., Imeri, H., Ipekci, A. M., Buitrago‐García, D., Heron, L., Amini, P., et al. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02247-9 · Cited by 15
“A living systematic review describes a review methodology that 74 allows updating information as soon as new evidence becomes available, rather than the 75 methods applied to classic, time-restricted systematic reviews (8,9).”
MethodMaskalyk, J. (2014) · PubMed Central · Cited by 9
Kataoka, Y., Luo, Y., Chaimani, A., Ōnishi, A., Kimachi, M., Tsujimoto, Y., Murad, M. H., Li, T., Cipriani, A., & Furukawa, T. A. (2020) · Archives of Osteoporosis · doi:10.1007/s11657-020-0697-8 · Cited by 13
“The importance of making timely recommendations to allow for updates to individual recommendations as soon as new relevant evidence becomes available has been recently receiving renewed interest as living systematic reviews [2, 38].”
BackgroundMarx, N., Rydén, L., Brosius, F. C., Ceriello, A., Cheung, M., Cosentino, F., Green, J., Kellerer, M., Koob, S., Kosiborod, M., et al. (2020) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2020.108092 · Cited by 10
Rapid Reviews to Support Practice: A Guide for Professional Organization Practice Networks
MacPherson, M., Wang, R. H., Smith, E., Sithamparanathan, G., Sadiq, C. A., & Braunizer, A. R. (2022) · Canadian Journal of Occupational Therapy · doi:10.1177/00084174221123721 · Cited by 10
“Similar to living systematic review, living rapid reviews can provide up-to-date summaries which are updated as new information becomes available (Elliott et al., 2014; Kelly et al., 2022).”
BackgroundPieper, D., & Mathes, T. (2017) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2016-110609 · Cited by 10
“To overcome this, the idea of living systematic reviews has been proposed where a systematic review is updated on a regular basis when new research becomes available.(5) However, this format is still in its infancy with many barriers ahead.”
BackgroundImproving Learning: Meta-analysis of Intervention Research in Education
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618 · Cited by 47
An Introduction to Living Systematic Reviews
Rezaeian, M. (2021) · مجله علمی دانشگاه علوم پزشکی رفسنجان · doi:10.52547/jrums.20.2.145 · Cited by 10
Manion, F. J., Du, J., Wang, D., He, L., Lin, B., Wang, J., Wang, S., Eckels, D., Cervenka, J., Fiduccia, P. C., et al. (2024) · JMIR Medical Informatics · doi:10.2196/54653 · Cited by 11
“There is considerable community interest in using AI such as machine learning (ML) and NLP to improve automation in aspects of literature reviews [2,5-7].”
BackgroundMansilla, C., Wang, Q., Piggott, T., Bragge, P., Waddell, K., Guyatt, G., Sweetman, A., & Lavis, J. N. (2024) · Implementation Science · doi:10.1186/s13012-024-01396-2 · Cited by 12
ContReviews: A content-based recommendation system for updating Living Evidences in health care
Tenti, P., Thomas, J., Peñaloza, R., & Pasi, G. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.112981 · Cited by 11
Self-citationVaghela, U., Rabinowicz, S., Bratsos, S., Martin, G., Fritzilas, E., Markar, S. R., Purkayastha, S., Stringer, K. S., Singh, H., Llewellyn, C., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25714 · Cited by 9
“Previous strategies have attempted to address these challenges by using the concepts of live systematic reviews, which involve the continuous, structured analysis of data that target specific clinical questions [6,7] as well as the clear presentation of such data [8].”
Development of a Knowledge-sharing Website for Hypersensitivity Pneumonitis Exposures
Barnes, H., Lu, J., & Johannson, K. A. (2022) · ATS Scholar · doi:10.34197/ats-scholar.2021-0139in · Cited by 10
“, real-world registry data) and publish evidence in multimodal digital formats that are readily and easily accessible (11).”
BackgroundWinters, M., Holden, S., Vicenzino, B., Welton, N. J., Caldwell, D. M., Lura, C. B., Weir, A., & Rathleff, M. S. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-022920 · Cited by 11
“The choice for these outcomes will be made based on availability, an outcome that allows for inclusion of the highest number of comparisons.”
Interactive, Up-to-date Meta-Analysis of MRI in the Management of Men with Suspected Prostate Cancer
Becker, A. S., Kirchner, J., Sartoretti, T., Ghafoor, S., Woo, S., Suh, C. H., Erinjeri, J. P., Hricak, H., & Vargas, H. A. (2020) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-019-00312-1 · Cited by 9
Updating systematic reviews can improve the precision of outcomes: a comparative study
Gao, Y., Yang, K., Cai, Y., Shi, S., Liu, M., Zhang, J., Wu, J., Tian, J., & Song, F. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.05.019 · Cited by 9
“Although there are many challenges in statistical m ethods, production processes, peer and editorial review, and publication [31-33], livi ng SRs may be particularly important in fields where research evidence is rapi dly emerging, current evidence is uncertain, and new research may change policy or pr actice decision…”
BackgroundMethodInfluenza A virus vaccine research conducted in swine from 1990 to May 2018: A scoping review
Keay, S., Poljak, Z., Klapwyk, M., O'Connor, A. M. C., Friendship, R. M., O’Sullivan, T. L., & Sargeant, J. M. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236062 · Cited by 10
“The contribution of conference proceedings to the broader evidence ecosystem as an alternate or an abridged reporting of research can be significant [6, 66, 96].”
BackgroundTechnology for Research Synthesis: An Application of Sociotechnical Systems Theory
Dell, N. A., Maynard, B. R., Murphy, A. M., & Stewart, M. (2021) · Journal of the Society for Social Work and Research · doi:10.1086/713525 · Cited by 11
“Living systematic reviews (LSRs) are an example of how technological change may support the modi fi cation of work processes and culture of evidence synthesis collaborations (Elliott et al., 2014).”
BackgroundIida, H., Okada, T., Nemoto, K., Hasegawa, N., Numata, S., Ogasawara, K., Miura, K., Matsumoto, J., Hori, H., Iga, J., et al. (2022) · Neuropsychopharmacology Reports · doi:10.1002/npr2.12300 · Cited by 11
Dawson, S., Kunonga, P., Beyer, F. R., Spiers, G., Booker, M. J., McDonald, R., Cameron, A., Craig, D., Hanratty, B., Salisbury, C., et al. (2020) · F1000Research · doi:10.12688/f1000research.25277.1 · Cited by 9
Metadata
- Authors
- Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L.
- Affiliations
- The Alfred Hospital (AU)
- Vision Australia (AU)
- University of London (GB)
- University of Bristol (GB)
- Corresponding author
- Elliott, Julian H.
- ORCID
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-02-18
- Volume
- 11
- Issue
- 2
- Pages
- e1001603
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3928029
- OpenAlex
- W2014453502
- Cited by
- 596
- References
- 35
- Citations by year
- 2026: 38 · 2025: 47 · 2024: 48 · 2023: 62 · 2022: 66 · 2021: 80 · 2020: 78 · 2019: 41 · 2018: 56 · 2017: 29 · 2016: 24 · 2015: 19 · 2014: 7
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Monash University Research Portal (Monash University) (submittedVersion, cc-by)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- Bristol Research (University of Bristol) (submittedVersion)
- Funders
- Medical Research Council (MR/J005037/1)
- National Health and Medical Research Council
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- living systematic review, review updating, knowledge-practice gap, evidence synthesis, health evidence, scholarly communication, evidence ecosystem, health care system
- MeSH terms
- Cooperative Behavior, Humans, Review Literature as Topic, Time Factors, Evidence-Based Medicine, Access to Information, Information Dissemination, Biomedical Research, Workflow
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.