PRISMA flow diagrams for living systematic reviews: a methodological survey and a proposal
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background : While the PRISMA flow diagram is widely used for reporting standard systematic reviews (SRs), it was not designed for capturing the results of continual searches for studies in living systematic reviews (LSRs). The objectives of this study are (1) to assess how published LSRs report on the flow of studies through the different phases of the review for the different updates; (2) to propose an approach to reporting on that flow. Methods : For objective 1, we identified all LSRs published up to July 2020. We abstracted information regarding their general characteristics and how they reported on search results. For objective 2, we based our proposal for tailored PRISMA approaches on the findings from objective 1, as well as on our experience with conducting Cochrane LSRs. Results: We identified 108 living publications relating to 32 LSRs. Of the 108 publications, 7% were protocols, 24% were base versions (i.e., the first version), 62% were partial updates (i.e., does not include all typical sections of an SR), and 7% were full updates (i.e., includes all typical sections of an SR). We identified six ways to reporting the study flow: base separately, each update separately (38%); numbers not reported (32%); latest update separately, all previous versions combined (20%); base separately, all updates combined (7%); latest update version only (3%); all versions combined (0%). We propose recording in detail the results of the searches to keep track of all identified records. For structuring the flow diagram, we propose using one of four approaches. Conclusion: We identified six ways for reporting the study flowthrough the different phases of the review for the different update versions. We propose to document in detail the study flow for the different search updates and select one of our four tailored PRISMA diagram approaches to present that study flow.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Self-citationDrug treatments for covid-19: living systematic review and network meta-analysis
Siemieniuk, R. A., Bartoszko, J. J., Zeraatkar, D., Kum, E., Qasim, A., Díaz Martinez, J. P., Izcovich, A., Rochwerg, B., Lamontagne, F., Han, M. A., et al. (2020) · BMJ · doi:10.1136/bmj.m2980 · Cited by 846
Self-citationLiving Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001603 · Cited by 596 · cited 7×
“Additional columns (F to I) present the distribution of the newly included reports as relating to either: (1) new studies, (2) previously included studies, (3) ongoing (unpublished) studies, or (4) preprints.”
InfluentialThe impact of the COVID-19 pandemic on self-harm and suicidal behaviour: a living systematic review
John, A., Okolie, C., Eyles, E., Webb, R. T., Schmidt, L., McGuinness, L. A., Olorisade, B. K., Arensman, E., Hawton, K., Kapur, N., et al. (2020) · F1000Research · doi:10.12688/f1000research.25522.1 · Cited by 178
Akl, E. A., Morgan, R. L., Rooney, A. A., Beverly, B., Katikireddi, S. V., Agarwal, A., Alper, B. S., Alva-Diaz, C., Amato, L., Ansari, M. T., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.09.037 · Cited by 34 · cited 1×
“Finally, improving the reporting of study flow in LSR methodology is essential for incorporating living evidence when developing living guidance, particularly in the context of an urgent response 30,31 .”
Self-citation
Research works printed but not linked: 18
- A Nasrallah, 2020, A large number of COVID-19 interventional clinical trials were registered soon after the pandemic onset: a descriptive analysis, J Clin Epidemiol., 125, 170-178, 10.1016/j.jclinepi.2020.06.005 · DOI
- G Currie, 2020, Protocol for a “living” evidence summary of primary research related to Covid-19, 10.17605/OSF.IO/Q5C2V · DOI
- B Geisler, 2020, Repurposing Existing Medications for Coronavirus Disease 2019: Protocol for a Rapid and Living Systematic Review., medRxiv., 10.1101/2020.05.21.20109074 · DOI
- S Juul, 2020, Interventions for treatment of COVID-19: a protocol for a living systematic review with network meta-analysis including individual patient data (The LIVING Project)., Syst Rev., 9, 108, 10.1186/s13643-020-01371-0 · DOI
- B Maguire, 2020, A living systematic review protocol for COVID-19 clinical trial registrations [version 1; peer review: 2 approved]., Wellcome Open Res., 5, 60, 10.12688/wellcomeopenres.15821.1 · DOI
- B Maguire, 2020, Baseline results of a living systematic review for COVID-19 clinical trial registrations [version 1; peer review: 2 approved]., Wellcome Open Res., 5, 116, 10.12688/wellcomeopenres.15933.1 · DOI
- H Schünemann, 2020, Ventilation techniques and risk for transmission of coronavirus disease, including COVID-19: a living systematic review of multiple streams of evidence., Ann Intern Med., 173, 204-216, 10.7326/M20-2306 · DOI · Paper page
- L Ortiz-Muñoz, 2020, Protocol of a Living systematic review: Gloves for the prevention of COVID-19 in healthy population, 10.31219/osf.io/qykh2 · DOI
- G Rada, 2020, Evidence synthesis relevant to COVID-19: a protocol for multiple systematic reviews and overviews of systematic reviews., Medwave., 20, e7868, 10.5867/medwave.2020.03.7867 · DOI
- I Boutron, 2020, Interventions for preventing and treating COVID-19: protocol for a living mapping of research and a living systematic review., Syst Rev., 9, 108, 10.1186/s13643-020-01371-0 · DOI
- T Millard, 2019, Feasibility and acceptability of living systematic reviews: results from a mixed-methods evaluation., Syst Rev., 8, 325, 10.1186/s13643-019-1248-5 · DOI · Paper page
- A Khamis, 2019, Methods of conduct and reporting of living systematic reviews: a protocol for a living methodological survey [version 2; peer review: 2 approved]., F1000Res., 8, 221, 10.12688/f1000research.18005.2 · DOI
- E Akl, 2017, Parenteral anticoagulation in ambulatory patients with cancer., Cochrane Database Syst Rev., 9, 10.1002/14651858.CD006652.pub5 · DOI · Paper page
- L Kahale, 2018, Anticoagulation for the long-term treatment of venous thromboembolism in people with cancer., Cochrane Database Syst Rev., 6, 10.1002/14651858.CD006650.pub5 · DOI
- L Kahale, 2017, Oral anticoagulation in people with cancer who have no therapeutic or prophylactic indication for anticoagulation., Cochrane Database Syst Rev., 12, 10.1002/14651858.CD006466.pub6 · DOI
- J Brooker, 2019, Guidance for the production and publication of Cochrane living systematic reviews: Cochrane reviews in living mode., Cochrane Collaboration.
- P Harris, 2009, Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support., J Biomed Inform., 42, 377-81, 10.1016/j.jbi.2008.08.010 · DOI · Paper page
- H Schünemann, 2020, Using GRADE in situations of emergencies and urgencies: certainty in evidence and recommendations matters during the COVID-19 pandemic, now more than ever and no matter what., J Clin Epidemiol., 127, 202-207, 10.1016/j.jclinepi.2020.05.030 · DOI · Paper page
Cited by
(2022) · doi:10.1371/journal.pmed.1003987 · Cited by 81
Iannizzi, C., Dorando, E., Burns, J., Weibel, S., Dooley, C., Wakeford, H., Estcourt, L. J., Skoetz, N., & Piechotta, V. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.09.013 · Cited by 45
Ibrahim, B., & Mensah, H. (2022) · SN Social Sciences · doi:10.1007/s43545-022-00383-y · Cited by 33
Iannizzi, C., Akl, E. A., Anslinger, E., Weibel, S., Kahale, L. A., Aminat, A. M., Piechotta, V., & Skoetz, N. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02396-x · Cited by 31
“The search strategy was initially developed by a researcher experienced in developing literature search strategies with support from an information specialist (LH), as part of a larger project to develop an extension of the PRISMA 2020 statement for LSRs [10, 11].”
MethodSelf-citationHow to update a living systematic review and keep it alive during a pandemic: a practical guide
Heron, L., Buitrago-Garcia, D., Ipekci, A. M., Baumann, R., Imeri, H., Salanti, G., Counotte, M. J., & Low, N. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02325-y · Cited by 26
“For reporting the results of searching, selection, and inclusion, a specific flow chart for living systematic reviews allows a logical way of updating [39].”
Background
Metadata
- Authors
- Kahale, L. A., Elkhoury, R., El Mikati, I., Pardo-Hernandez, H., Khamis, A. M., Schünemann, H. J., Haddaway, N. R., & Akl, E. A.
- Venue
- F1000Research
- Publisher
- F1000 Research Ltd
- Published
- 2021-03-08
- Volume
- 10
- Pages
- 192
- ISSN
- 2046-1402 (ISSN-L)
- OpenAlex
- W3133707781
- Cited by
- 33
- References
- 5
- FWCI
- 0.23
- Type
- journal article
- Language
- en
- Update notices
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.