Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
The current difficulties in keeping systematic reviews up to date leads to considerable inaccuracy, hampering the translation of knowledge into action. Incremental advances in conventional review updating are unlikely to lead to substantial improvements in review currency. A new approach is needed. We propose living systematic review as a contribution to evidence synthesis that combines currency with rigour to enhance the accuracy and utility of health evidence. Living systematic reviews are high quality, up-to-date online summaries of health research, updated as new research becomes available, and enabled by improved production efficiency and adherence to the norms of scholarly communication. Together with innovations in primary research reporting and the creation and use of evidence in health systems, living systematic review contributes to an emerging evidence ecosystem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“for a primary study, it takes 2.5 - 6.5 years before it is incorporated in an SLR study [7,8].”
From Automation of systematic literature reviews: A systematic literature review (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Between 2014 (when the LSR approach first emerged 3 ) and 2019, the rate of publication of these systematic reviews was low; however, since 2019, there has been a rapid increase.”
From Extension of the PRISMA 2020 statement for living systematic reviews (PRISMA-LSR): checklist and explanation (2024) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“The most efficient use and application of the machine-learning technologies would be in the areas allowing automation of specific SR processes, in particular those involving time-consuming and resource-intensive tasks such as language translation [15], study selection [11, 16–18], data extraction [19] and risk of bias assessment [20].”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“Living systematic reviews are dynamic and constantly changing online-only evidence summaries that demand less intensive work over time compared to static and sporadically more resource-intensive conventional SRs.”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“The authors proposed to initiate living systematic reviews, which represent high-quality online evidence summaries, continuously updated as any new relevant evidence becomes available.”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [18]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Knowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407 · cited 1×
“The reasons for this gap are complex [2], but it is clear that synthesising the complex, incomplete, and at times conflicting findings of biomedical research into forms that can readily inform health decision making is an essential component of the bridge from ‘‘knowing’’ to ‘‘doing.”
BackgroundTrial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881 · cited 1×
“Statistical monitoring of metaanalyses using formal sequential methods can control the risk of spurious findings, while achieving pre-specified power to identify a pre-specified clinically relevant magnitude of effect [16,17].”
MethodCentral challenges facing the national clinical research enterprise
Sung, N. S., Crowley, W. F., Genel, M., Salber, P., Sandy, L., Sherwood, L. M., Johnson, S. B., Catanese, V., Tilson, H., Getz, K., et al. (2003) · JAMA · doi:10.1001/jama.289.10.1278 · Cited by 1,235
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Finding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 943
How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-4-200708210-00179 · Cited by 838 · cited 1×
“By 2 years post-publication 23% of SRs that have not been updated will have failed to incorporate new evidence that would substantively change conclusions about the effectiveness or harms of therapies [9].”
Background
Research works printed but not linked: 4
- 22. Elliott J (2012) Exploiting innovations in technology to improve the efficiency of review production. 20th Cochrane Colloquium. Auckland.
- 23. Ciapponi A, Glujovsky D (2012) Survey among Cochrane authors about early stages of systematic reviews. In: Proceedings of the 20th Cochrane Colloquium; 30 September–3 October 2012 Auckland, New Zealand
- 34. McGee R, Willis N, Jones A, Higgins G, Craig J, et al.. (2012) Factors associated with the timely completion of a Cochrane review. In: Proceedings of the 20th Cochrane Colloquium; 30 September–3 October 2012Auckland, New Zealand
- 38. Noel-Storr A, Struthers C, Huckvale C, Dooley G, McShane R (2012) ALOIS, ScreenToGo and the Cochrane Register of Studies: using mobile technology to engage and involve consumers in the work of the Cochrane Collaboration. In: Proceedings of the 20th Cochrane Colloquium; 30 September–3 October 2012Auckland, New Zealand.
Cited by
Items 101–200 of 591
Implementing early mobilisation in the intensive care unit: An integrative review
Phelan, S., Lin, F. F., Mitchell, M. L., & Chaboyer, W. P. (2017) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.09.019 · Cited by 67
Abbott, R., Bethel, A., Rogers, M., Whear, R., Orr, N., Shaw, L., Stein, K., & Thompson Coon, J. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2021-111710 · Cited by 56
“…of systematic review evidence on COVID-19 between December 2019 and July 2020 to answer the following questions: We planned to conduct a living systematic mapping review, 14 with initial searches from December 2019, regular and frequent update searches and an online summary of relevant evidence.”
InfluentialEarly goal-directed therapy for severe sepsis and septic shock: A living systematic review
Simpson, S. Q., Gaines, M., Hussein, Y., & Badgett, R. G. (2016) · Journal of Critical Care · doi:10.1016/j.jcrc.2016.06.017 · Cited by 55
Freiberg, A., Schubert, M., Starke, K. R., Hegewald, J., & Seidler, A. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18168567 · Cited by 64
“Another approach for a continuous update would be to conduct a living systematic review to “incorporate relevant new evidence as it becomes available” [109,110], which seems to be important during the COVID-19 pandemic because the pandemic “has led to an explosion of scientific literature” [111].”
BackgroundInforming conservation decisions through evidence synthesis and communication
Pullin, A. S., Cheng, S. H., Cooke, S. J., Haddaway, N., Macura, B., McKinnon, M., & Taylor, J. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108638210.007 · Cited by 56
“These costs are particularly prohibitive for organisations with critical needs for evidence, but who have limited time and resources to engage in such synthesis efforts or even to glean needed information from lengthy synthesis reports (Elliott et al., 2014).”
BackgroundGates, A., Vandermeer, B., & Hartling, L. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.12.015 · Cited by 60
Weather and crime: a systematic review of the empirical literature
Corcoran, J., & Zahnow, R. (2022) · Crime Science · doi:10.1186/s40163-022-00179-8 · Cited by 52
“To enhance the currency and coverage of the articles captured principles of the living systematic review methodology were adopted (Elliott et al., 2014).”
MethodThe role of smoking in COVID-19 progression: a comprehensive meta-analysis
Gallus, S., Scala, M., Possenti, I., Jarach, C. M., Clancy, L., Fernández, E., Gorini, G., Carreras, G., Malevolti, M. C., Commar, A., et al. (2023) · European Respiratory Review · doi:10.1183/16000617.0191-2022 · Cited by 54
“One of these reviews [8] was part of a living systematic review, i.e. a review that is updated rapidly as soon as new evidence becomes available [15] with additional updates in Qeios, a pre-print platform.”
Past, present and future of living systematic review: a bibliometrics analysis
Zheng, Q., Xu, J., Gao, Y., Liu, M., Cheng, L., Xiong, L., Cheng, J., Yuan, M., OuYang, G., Huang, H., et al. (2022) · BMJ Global Health · doi:10.1136/bmjgh-2022-009378 · Cited by 51
The Cooperation Databank: Machine-Readable Science Accelerates Research Synthesis
Spadaro, G., Tiddi, I., Columbus, S., Jin, S., ten Teije, A., CoDa Team, & Balliet, D. P. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211053319 · Cited by 86
“One of the major benefits of storing the scientific information in this format is the possibility to implement and publish living reviews—up-to-date summaries of research findings that are automatically updated as new information becomes available (Elliott et al., 2014).”
BackgroundCloud-based Meta-analysis to Bridge Science and Practice: Welcome to metaBUS
Bosco, F., Steel, P., Oswald, F., Uggerslev, K., & Field, J. (2015) · Personnel Assessment and Decisions · doi:10.25035/pad.2015.002 · Cited by 51
“Drawing on such efforts, “living” systematic reviews are making possible the continual updating of meta-analytic inputs, a process championed as a vehicle for narrowing the evidence–practice gap (Elliott et al., 2014, p. 1).”
BackgroundBiomarkers for Traumatic Brain Injury: Data Standards and Statistical Considerations
Huie, J. R., Mondello, S., Lindsell, C. J., Antiga, L., Yuh, E. L., Zanier, E. R., Masson, S., Rosario, B. L., Ferguson, A. R., Adeoye, O. M., et al. (2021) · Journal of Neurotrauma · doi:10.1089/neu.2019.6762 · Cited by 59
“72,73 In response to this, the ‘‘living systematic review’’ initiative has been launched, pioneered by CENTER-TBI 75 and the Cochrane Collaboration (www.center-tbi.eu/publications/LSR; https://community.cochrane.org/review-production/production-resources/living-systematic-reviews).”
Coiera, E., & Liu, S. (2022) · Cell Reports Medicine · doi:10.1016/j.xcrm.2022.100860 · Cited by 48
“22 Living meta-analyses have been created for many COVID-19 treatments, 23 with the Cochrane Collaboration piloting the approach, reappraising literature every 1 to 3 months.”
MethodContinuously updated network meta-analysis and statistical monitoring for timely decision-making
Nikolakopoulou, A., Mavridis, D., Egger, M., & Salanti, G. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280216659896 · Cited by 50
“Development, refinement, and evaluation of appropriate statistical methodology as well as guidance over the optimal update of systematic reviews can aid the attempt of living systematic reviews and live cumulative NMA to bridge the gap between research evidence and health care practice.(4) Methodology described in thi…”
MethodThe evidence ecosystem in South Africa: growing resilience and institutionalisation of evidence use
Stewart, R. J., Dayal, H., Langer, L., & van Rooyen, C. (2019) · Humanities and Social Sciences Communications · doi:10.1057/s41599-019-0303-0 · Cited by 64
“The term ‘evidence ecosystem’ is increasingly referred to, although not yet well defined (Elliott et al., 2014; Shepherd, 2014).”
BackgroundZorko, D. J., Gertsman, S., O’Hearn, K., Timmerman, N. P., Ambu-Ali, N., Dinh, T., Sampson, M., Sikora, L., McNally, J. D., & Choong, K. L. M. (2020) · Journal of Hospital Infection · doi:10.1016/j.jhin.2020.07.007 · Cited by 49
Russell-Rose, T., & Chamberlain, J. (2017) · JMIR Medical Informatics · doi:10.2196/medinform.7680 · Cited by 49
“conflicting findings of biomedical research into a form that can readily inform healthcare decision making [6].”
BackgroundWinters, M., Holden, S., Lura, C. B., Welton, N. J., Caldwell, D. M., Vicenzino, B. T., Weir, A., & Rathleff, M. S. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-102819 · Cited by 48
Cramond, F., O’Mara-Eves, A., Doran-Constant, L., Rice, A. S. C., Macleod, M. R., & Thomas, J. (2018) · Wellcome Open Research · doi:10.12688/wellcomeopenres.14738.1 · Cited by 49
Self-citationKahale, L. A., Elkhoury, R., El Mikati, I., Pardo-Hernandez, H., Khamis, A. M., Schünemann, H. J., Haddaway, N. R., & Akl, E. A. (2022) · F1000Research · doi:10.12688/f1000research.51723.3 · Cited by 48
Counotte, M. J., Egli-Gany, D., Riesen, M., Abraha, M., Porgo, T. V., Wang, J., & Low, N. N. (2018) · F1000Research · doi:10.12688/f1000research.13704.1 · Cited by 49
Dynamic meta-analysis: a method of using global evidence for local decision making
Shackelford, G. E., Martin, P. A., Hood, A. S. C., Christie, A. P., Kulinskaya, E., & Sutherland, W. J. (2021) · BMC Biology · doi:10.1186/s12915-021-00974-w · Cited by 52
Trail running injury risk factors: a living systematic review
Viljoen, C. T., van Rensburg, D. C. (. J., van Mechelen, W., Verhagen, E. A. L. M., Silva, B., Scheer, V., Besomi, M., Gajardo-Burgos, R. E., Matos, S., Schoeman, M., et al. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-104858 · Cited by 61
Report from the kick-off meeting of the Cochrane Skin Group Core Outcome Set Initiative (CSG-COUSIN)
Schmitt, J. M., Deckert, S., Alam, M., Apfelbacher, C., Barbarić, J., Bauer, A., Chalmers, J. R., Chosidow, O., Delamere, F. M., Doney, L., et al. (2016) · British Journal of Dermatology · doi:10.1111/bjd.14337 · Cited by 52
Planning future studies based on the precision of network meta‐analysis results
Nikolakopoulou, A., Mavridis, D., & Salanti, G. (2016) · Statistics in Medicine · doi:10.1002/sim.6608 · Cited by 45
Automated screening of research studies for systematic reviews using study characteristics
Tsafnat, G., Glasziou, P., Karystianis, G., & Coiera, E. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0724-7 · Cited by 44
“The relentless growth in research and the greater reliance placed on evidence for clinical and policy decisions have created a need for automation to support the process of systematic reviews [1, 2].”
BackgroundThe Systematic Review Toolbox: keeping up to date with tools to support evidence synthesis
Johnson, E. E., O’Keefe, H., Sutton, A., & Marshall, C. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02122-z · Cited by 57
“Living systematic reviews have also been proposed as a contribution to evidence synthesis by providing highquality reviews that are updated as new research in the area becomes available [14].”
BackgroundLeveraging AI to improve evidence synthesis in conservation
Berger‐Tal, O., Wong, B. B. M., Adams, C. A., Blumstein, D. T., Candolin, U., Gibson, M. J., Greggor, A. L., Lagisz, M., Macura, B., Price, C. J., et al. (2024) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2024.04.007 · Cited by 58
“Living systematic reviews have been developed to provide high-quality, up-to-date online summaries that incorporate relevant new evidence as it becomes available [28,30].”
BackgroundBougioukas, K. I., Bouras, E., Avgerinos, K. I., Dardavessis, T., & Haidich, A. (2020) · Health Information & Libraries Journal · doi:10.1111/hir.12318 · Cited by 57
Understanding different types of review articles: A primer for early career researchers
Ghosh, A., & Choudhury, S. (2025) · Indian Journal of Psychiatry · doi:10.4103/indianjpsychiatry.indianjpsychiatry_373_25 · Cited by 54
“[20] Please see the summary Table 1 purpose, methods, strengths, limitations, and common reporting guidelines for different types of reviews.”
Day-to-day discovery of preprint–publication links
Cabanac, G., Oikonomidi, T., & Boutron, I. (2021) · Scientometrics · doi:10.1007/s11192-021-03900-7 · Cited by 43
“A living systematic review provides a frequently updated report on a specific research question (Elliott et al. 2014; Ravaud et al. 2020).”
BackgroundLewin, S. A., Glenton, C., Lawrie, T. A., Downe, S. M., Finlayson, K. W., Rosenbaum, S., Barreix, M., & Tunçalp, Ö. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-019-0468-4 · Cited by 48
Korang, S. K., Juul, S., Nielsen, E. E., Feinberg, J. B., Siddiqui, F., Ong, G., Klingenberg, S. L., Veroniki, A. A., Bu, F.-L., Thabane, L., et al. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01516-1 · Cited by 46
Aldin, A., Besiroglu, B., Adams, A., Monsef, I., Piechotta, V., Tomlinson, E., Hornbach, C., Dressen, N., Goldkuhle, M., Maisch, P., et al. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013798.pub2 · Cited by 51
The views of health guideline developers on the use of automation in health evidence synthesis
Arno, A., Elliott, J., Wallace, B., Turner, T., & Thomas, J. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01569-2 · Cited by 40
Self-citationTonin, F. S., Borba, H. H. L., Leonart, L. P., Mendes, A. M., Steimbach, L. M., Pontarolo, R., & Fernández-Llimós, F. (2018) · International Journal of Epidemiology · doi:10.1093/ije/dyy197 · Cited by 42
Reproducible Research in R: A Tutorial on How to Do the Same Thing More Than Once
Peikert, A., Lissa, C. J. V., & Brandmaier, A. M. (2021) · Psych · doi:10.3390/psych3040053 · Cited by 46
Performance of Antigen Detection Tests for SARS-CoV-2: A Systematic Review and Meta-Analysis
Tapari, A., Braliou, G. G., Papaefthimiou, M., Mavriki, H., Kontou, P. I., Nikolopoulos, G. K., & Bagos, P. G. (2022) · Diagnostics · doi:10.3390/diagnostics12061388 · Cited by 38
“Such reviews may be particularly important in fields where research evidence is emerging rapidly [266,267], and clearly, the COVID-19 pandemic is a perfect example of a field where new research accumulates in an unprecedented way and an updated meta-analysis is needed.”
BackgroundChapman, A., Rankin, N. M., Jongebloed, H., Yoong, S. L., White, V., Livingston, P. M., Hutchinson, A. M., & Ugalde, A. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02285-3 · Cited by 36
“The ensuing lengthy screening processes increase the risk that review findings are out of date or inaccurate by the time a systematic review is published [22].”
BackgroundGathering speed and countering tensions in the rapid learning health system
Reid, R. J., & Greene, S. M. (2023) · Learning Health Systems · doi:10.1002/lrh2.10358 · Cited by 42
Future of evidence ecosystem series: 2. current opportunities and need for better tools and methods
Créquit, P., Boutron, I., Meerpohl, J., Williams, H. C., Craig, J., & Ravaud, P. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.023 · Cited by 36
“some researchers proposed new methods — living systematic reviews [60] — representing high-quality, up-to-date evidence synthesis, updated several times per year to add all new”
BackgroundMethodNunn, J., & Chang, S. (2020) · WikiJournal of Medicine · doi:10.15347/wjm/2020.005 · Cited by 65
Shin, S., Aziz, D., El-Sayed, M. E. A., Hazman, M. Y., Almas, L. K., McFarland, M., Din, A. S. E., & Burian, S. J. (2022) · Water · doi:10.3390/w14203343 · Cited by 46
Systematic online living evidence summaries: emerging tools to accelerate evidence synthesis
Hair, K., Wilson, E., Wong, C., Tsang, A., Macleod, M. R., & Bannach‐Brown, A. (2023) · Clinical Science · doi:10.1042/cs20220494 · Cited by 39
Comparative study of millennials' (age 20-34 years) grip and lateral pinch with the norms
Fain, E. A., & Weatherford, C. (2016) · Journal of Hand Therapy · doi:10.1016/j.jht.2015.12.006 · Cited by 38
Nama, N., Iliriani, K., Xia, M. Y., Chen, B. P., Zhou, L. L., Pojsupap, S., Kappel, C., O’Hearn, K., Sampson, M., Menon, K., et al. (2017) · Translational Pediatrics · doi:10.21037/tp.2016.12.01 · Cited by 36
“In addition to initial systematic reviews, crowdsourcing may facilitate updates of previously published reviews, or contribute to real-time up-to-date online “living systematic reviews” (29,30).”
BackgroundNakayama, T., Imanaka, Y., Okuno, Y., Kato, G., Kuroda, T., Goto, R., Tanaka, S., Tamura, H., Fukuhara, S., Fukuma, S., et al. (2017) · Environmental Health and Preventive Medicine · doi:10.1186/s12199-017-0644-5 · Cited by 35
Bach‐Mortensen, A., Verboom, B., Movsisyan, A., & Esposti, M. D. (2021) · Nature Aging · doi:10.1038/s43587-021-00106-7 · Cited by 42
Living systematic reviews at The BMJ
Macdonald, H., Loder, E., & Abbasi, K. (2020) · BMJ · doi:10.1136/bmj.m2925 · Cited by 35
Simons, D., Shahab, L., Brown, J., & Perski, O. (2020) · Qeios · doi:10.32388/ujr2aw.8 · Cited by 38
Systematic Reviews in Educational Research: Methodology, Perspectives and Application
(2020) · doi:10.1007/978-3-658-27602-7 · Cited by 467
“This means that the distribution of review effort is quite different to a standard systematic review, being a continuous lower-level effort spread over a longer time period, rather than the shorter bursts of intensive effort that characterise a review with periodic updates (Elliott et al. 2014).”
BackgroundCumulative meta‐analysis: What works
Kulinskaya, E., & Mah, E. Y. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1522 · Cited by 35
“But the use of CMA has grown substantially because of the growing popularity of living systematic reviews, online summaries updated as new research becomes available.(24) CMA also provides a graphical representation of shifts in evidence associated with other factors such as sample size, precision, or study quality.”
BackgroundGaps and priorities in advancing methods for health behaviour change research
Byrne, M. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1707106 · Cited by 35
“systematic reviews’, which are high quality, up-to-date online summaries of health research, updated as new research become available (Elliott et al., 2014).”
BackgroundInfluentialEstimating temporary populations: a systematic review of the empirical literature
Panczak, R., Charles‐Edwards, E., & Corcoran, J. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0455-y · Cited by 39
“In order to enhance the currency and coverage of the articles captured principles of the living systematic review methodology were adopted (Elliott et al., 2014).”
MethodGarcía, L. M., Hernandez, H. P., Superchi, C., de Guzmán, E. N., Ballesteros, M., Ibargoyen-Roteta, N., McFarlane, E., Posso, M., Figuls, M. R. I., del Campo, R. R., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.05.008 · Cited by 38
Measuring the impact of screening automation on meta-analyses of diagnostic test accuracy
Norman, C. R., Leeflang, M. M. G., Porcher, R., & Névéol, A. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1162-x · Cited by 33
Carvallo, A., Parra, D., Löbel, H., & Soto, Á. (2020) · Scientometrics · doi:10.1007/s11192-020-03648-6 · Cited by 44
“As a consequence, the time required for search and screening of articles can take long, and sometimes it consumes a large part of a physician’s workday (Miwa et al. 2014; Elliott et al. 2014).”
BackgroundPRISMA flow diagrams for living systematic reviews: a methodological survey and a proposal
Kahale, L. A., Elkhoury, R., El Mikati, I., Pardo-Hernandez, H., Khamis, A. M., Schünemann, H. J., Haddaway, N. R., & Akl, E. A. (2021) · F1000Research · doi:10.12688/f1000research.51723.1 · Cited by 33
“Additional columns (F to I) present the distribution of the newly included reports as relating to either: (1) new studies, (2) previously included studies, (3) ongoing (unpublished) studies, or (4) preprints.”
InfluentialMethods for developing and reporting living evidence synthesis
Bendersky, J., Auladell-Rispau, A., Urrútia, G., & Rojas, M. X. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.09.020 · Cited by 34
Maguire, B., Dahal, P., Rashan, S., Ngu, R. C., Boon, A., Forsyth, C., Wourgaft, N. S., Chatelain, E., Barreira, F., Sosa‐Estáni, S., et al. (2021) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0009697 · Cited by 33
“For this reason, and as a next phase to this systematic review, IDDO seeks to minimise this universal inefficiency by conducting regularly scheduled search updates and providing ongoing results to this project in a living systematic review (LSR) format [47,48].”
BackgroundPerlman‐Arrow, S., Loo, N., Bobrovitz, N., Yan, T., & Arora, R. K. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1636 · Cited by 30
“[4, 5] Living systematic reviews are designed to circumvent delays and provide up-to-date results, [6, 7] but it is similarly laborious to update these at an adequate frequency.”
BackgroundAmer, Y. S., Titi, M. A., Godah, M. W., Wahabi, H., Hneiny, L., Abouelkheir, M. M., Hamad, M. H., ElGohary, G. M., Hamouda, M. B., Ouertatani, H., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.11.010 · Cited by 34
“Considering the rapid evolution of the pandemic, the unprecedented and extraordinary volume and speed of the evidence production with COVID-19 and the need for rapid evidence synthesis and guidance, the concept of “living reviews” and “living guidance” became relevant more than ever [19] .”
BackgroundPattuwage, L., Olver, J., Martin, C., Lai, F. Y. X., Piccenna, L. G., Gruen, R. L., & Bragge, P. (2016) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000234 · Cited by 38
Self-citationProgress and challenges of network meta‐analysis
Tian, J., Gao, Y., Zhang, J., Yang, Z., Dong, S., Zhang, T., Sun, F., Wu, S., Wu, J., Wang, J., et al. (2021) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12443 · Cited by 29
Counotte, M. J., Meili, K. W., Taghavi, K., Calvet, G., Sejvar, J., & Low, N. (2019) · F1000Research · doi:10.12688/f1000research.19918.1 · Cited by 29
Iannizzi, C., Akl, E. A., Anslinger, E., Weibel, S., Kahale, L. A., Aminat, A. M., Piechotta, V., & Skoetz, N. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02396-x · Cited by 31
“…( N = 8/17) • Set up auto alerts to provide a regular feed of new citations [14] • Continuous search (e.g., varying between weekly and monthly) [1, 3, 13, 14, 16, 19, 28, 29] Database ( N = 2/17) • Bibliographic databases, clinical trials registries, gray literature [3, 14] Who ( N = 1/17) •…”
BackgroundMethodInfluentialTask-specific algorithm advice acceptance: A review and directions for future research
Kaufmann, E., Chacón, A., Kausel, E., Herrera, N., & Reyes, T. (2023) · Data and Information Management · doi:10.1016/j.dim.2023.100040 · Cited by 30
Créquit, P., Trinquart, L., & Ravaud, P. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011841 · Cited by 30
“Living systematic reviews are online summaries of health research updated as new research becomes available.(11) Rapid updates are particularly needed in therapeutic fields such as advanced NSCLC, in which new second-line”
BackgroundBaseline results of a living systematic review for COVID-19 clinical trial registrations
Maguire, B., McLean, A. R. D., Rashan, S., Antonio, E. S., Bagaria, J., Bentounsi, Z., Brack, M., Caldwell, F., Carrara, V. I., Citarella, B. W., et al. (2020) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15933.1 · Cited by 29
Guidelines and Safety Practices for Improving Patient Safety
Ricciardi, W., & Cascini, F. (2020) · Springer eBooks · doi:10.1007/978-3-030-59403-9_1 · Cited by 43
Designing for Hybrid Intelligence: A Taxonomy and Survey of Crowd-Machine Interaction
Correia, A., Grover, A., Schneider, D., Pimentel, A. P., Chaves, R., de Almeida, M. A., & Fonseca, B. (2023) · Applied Sciences · doi:10.3390/app13042198 · Cited by 34
Bover, J., Ureña, P., Mateu, S., daSilva, I., Gràcia, S., Sánchez-Baya, M., Arana, C., de Arizón, L. F., Guirado, L., & Cozzolino, M. G. (2019) · Clinical Kidney Journal · doi:10.1093/ckj/sfz187 · Cited by 29
“‘Living’ systematic reviews and ‘living’ guideline recommendations [68, 69] may help solving this last problem.”
BackgroundTakata, J., Sondo, P., Humphreys, G. S., Burrow, R., Maguire, B., Hossain, M. S., Das, D., Commons, R. J., Price, R. N., & Guerin, P. J. (2020) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.19-0706 · Cited by 25
Riaz, I. B., Fuentes, H. E., Naqvi, S. A. A., He, H., Sipra, Q.-U.-A. R., Tafur, A. J., Padranos, L., Wysokiński, W. E., Marshall, A. L., Vandvik, P. O., et al. (2021) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2020.10.041 · Cited by 27
Facilitating the wise use of experts and evidence to inform local environmental decisions
MacLeod, C. J., Brandt, A. J., & Dicks, L. V. (2022) · People and Nature · doi:10.1002/pan3.10328 · Cited by 27
Arno, A., Thomas, J., Wallace, B., Marshall, I. J., McKenzie, J. E., & Elliott, J. (2022) · Annals of Internal Medicine · doi:10.7326/m22-0092 · Cited by 30
Self-citationAfonso, J. R., Olivares-Jabalera, J., Fernandes, R. J., Clemente, F. M., Rocha‐Rodrigues, S., Claudino, J. G., Ramírez‐Campillo, R., Valente, C., Andrade, R., & Espregueira‐Mendes, J. (2023) · Sports Medicine · doi:10.1007/s40279-022-01783-z · Cited by 30
“Considering that data from systematic reviews may quickly become outdated [42], living reviews provide a regularly updated summary of the most up-to-date evidence [43].”
BackgroundLuo, J., Chen, Z., Liu, D., Li, H., He, S., Zeng, L., Yang, M., Liu, Z., Xiao, X., & Zhang, L. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-01980-y · Cited by 27
“Inability to maintain currency under the COVID19 pandemic may lead to significant inaccuracy [14].”
BackgroundLin, F. F., Phelan, S., Chaboyer, W. P., & Mitchell, M. L. (2019) · Australian Critical Care · doi:10.1016/j.aucc.2019.02.002 · Cited by 39
Rosati, P., Porzsolt, F., Ricciotti, G., Testa, G., Inglese, R., Giustini, F., Fiscarelli, E. V., Zazza, M., Carlino, C., Balassone, V., et al. (2016) · Trials · doi:10.1186/s13063-016-1551-6 · Cited by 31
The Cooperation Databank: Machine-Readable Science Accelerates Research SynthesisPreprint
Spadaro, G., Tiddi, I., Columbus, S., Jin, S., ten Teije, A., & Balliet, D. P. (2020) · doi:10.31234/osf.io/rveh3 · Cited by 26
Hopkin, G., Au, A., Collier, V. J., Yudkin, J. S., Basu, S., & Naci, H. (2019) · Medical Decision Making · doi:10.1177/0272989x19835239 · Cited by 26
Hanney, S. R., Straus, S. E., & Holmes, B. J. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00883-6 · Cited by 34
Nikolova, S., & Small, E. (2018) · Journal of HIV/AIDS & Social Services · doi:10.1080/15381501.2017.1407727 · Cited by 24
“We used Covidence, a web-based platform that helps stream the production of systematic reviews (Elliott et al., 2014) and coordinate the search.”
BackgroundMethodInfluentialMartin, P. B., Surian, D., Bashir, R., Bourgeois, F. T., & Dunn, A. G. (2019) · JAMIA Open · doi:10.1093/jamiaopen/ooy062 · Cited by 26
What have we learned after ten years of systematic reviews in international development?
Waddington, H. S., Masset, E., & Jiménez, E. (2018) · Journal of Development Effectiveness · doi:10.1080/19439342.2018.1441166 · Cited by 35
“These include the production of ‘living systematic reviews’ whereby reviews are an online document which is persistent, dynamic and constantly updated as more evidence becomes available (Elliott et al. 2014).”
BackgroundMarshall, I. J., Trikalinos, T. A., Soboczenski, F., Yun, H. S., Kell, G., Marshall, R., & Wallace, B. C. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.08.013 · Cited by 23
Rogers, K., Hirzle, T., Karaosmanoglu, S., Palomino, P. T., Durmanova, E., Isotani, S., & Nacke, L. E. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3685266 · Cited by 26
Homiar, A., Thomas, J., Ostinelli, E. G., Kennett, J., Friedrich, C., Cuijpers, P. J., Harrer, M., Leucht, S., Miguel, C., Rodolico, A., et al. (2025) · BMJ Mental Health · doi:10.1136/bmjment-2025-301762 · Cited by 46
Self-citationDressler, C., Lambert, J., Grine, L., Galdas, P., Paul, C. F., Zidane, M., & Nast, A. (2019) · JDDG Journal der Deutschen Dermatologischen Gesellschaft · doi:10.1111/ddg.13840 · Cited by 28
The Development of a Living Knowledge System and Implications for Future Systematic Searching
Grbin, L., Nichols, P., Russell, F., Fuller‐Tyszkiewicz, M., & Olsson, C. A. (2022) · Journal of the Australian Library and Information Association · doi:10.1080/24750158.2022.2087954 · Cited by 28
“These solutions supported tasks such as ongoing evidence sourcing and updating existing reviews to re fl ect fi ndings from the most recent literature (Elliott et al., 2014).”
BackgroundMethodKrauer, F., Riesen, M., Revéiz, L., Oladapo, O. T., Martínez-Vega, R. A., Porgo, T. V., Haefliger, A., Broutet, N. J. N., Low, N. N., & for the WHO Zika Causality Working Group (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/073098 · Cited by 23
The life and death of living systematic reviews: a methodological survey
Akl, E. A., El Khoury, R., Khamis, A. M., El Mikati, I. K., Pardo-Hernandez, H., Farran, S., Ibrahim, R., Khamis, M., Hneiny, L., Schunemann, H. J., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.02.005 · Cited by 21
Prospective approaches to accumulating evidence
Thomas, J., Askie, L. M., Berlin, J. A., Elliott, J. H., Ghersi, D., Simmonds, M., Takwoingi, Y., Tierney, J. F., & Higgins, J. P. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch22 · Cited by 26
Self-citationWhy Cochrane should prioritise sharing data
Shokraneh, F., Adams, C. E., Clarke, M., Amato, L., Bastian, H., Beller, E., Brassey, J., Buchbinder, R., Davoli, M., Del Mar, C., et al. (2018) · BMJ · doi:10.1136/bmj.k3229 · Cited by 21
Mansilla, C., Herrera, C. A., Basagoitía, A., & Pantoja, T. (2017) · Revista Panamericana de Salud Pública · doi:10.26633/rpsp.2017.36 · Cited by 27
Keeping Up With Emerging Evidence in (Almost) Real Time
Laine, C. M., Taichman, D. B., Güallar, E., & Mulrow, C. D. (2020) · Annals of Internal Medicine · doi:10.7326/m20-2627 · Cited by 21
Barriers and facilitators to best care for idiopathic pulmonary fibrosis in Australia
Tikellis, G., Corte, T. J., Teoh, A. K. Y., Glaspole, I., Macansh, S., & Holland, A. E. (2021) · Respirology · doi:10.1111/resp.14185 · Cited by 19
“No, not available 5 (13) Yes, within the institution 29 (76) Yes, outside the institution 4 (11) Oxygen therapy No, not available 0 (0) Yes, within the institution 35 (92)”
BackgroundFrom standard systematic reviews to living systematic reviews
Breuer, C., Meerpohl, J. J., & Siemens, W. (2023) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2022.11.007 · Cited by 21
A New Approach to Evidence Synthesis in Traumatic Brain Injury: A Living Systematic Review
Synnot, A., Gruen, R. L., Menon, D. K., Steyerberg, E. W., Büki, A., Peul, W. C., Elliott, J., & Maas, A. I. R. (2015) · Journal of Neurotrauma · doi:10.1089/neu.2015.4124 · Cited by 25
“10 Operationalizing the LSR concept requires sufficient technological infrastructure, the likes of which has only recently emerged.”
Self-citation
Metadata
- Authors
- Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L.
- Affiliations
- The Alfred Hospital (AU)
- Vision Australia (AU)
- University of London (GB)
- University of Bristol (GB)
- Corresponding author
- Elliott, Julian H.
- ORCID
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-02-18
- Volume
- 11
- Issue
- 2
- Pages
- e1001603
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3928029
- OpenAlex
- W2014453502
- Cited by
- 596
- References
- 35
- Citations by year
- 2026: 38 · 2025: 47 · 2024: 48 · 2023: 62 · 2022: 66 · 2021: 80 · 2020: 78 · 2019: 41 · 2018: 56 · 2017: 29 · 2016: 24 · 2015: 19 · 2014: 7
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Monash University Research Portal (Monash University) (submittedVersion, cc-by)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- Bristol Research (University of Bristol) (submittedVersion)
- Funders
- Medical Research Council (MR/J005037/1)
- National Health and Medical Research Council
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- living systematic review, review updating, knowledge-practice gap, evidence synthesis, health evidence, scholarly communication, evidence ecosystem, health care system
- MeSH terms
- Cooperative Behavior, Humans, Review Literature as Topic, Time Factors, Evidence-Based Medicine, Access to Information, Information Dissemination, Biomedical Research, Workflow
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.