Vaccines to prevent COVID-19: A living systematic review with Trial Sequential Analysis and network meta-analysis of randomized clinical trials
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Background: COVID-19 is rapidly spreading causing extensive burdens across the world. Effective vaccines to prevent COVID-19 are urgently needed. Methods and findings: Our objective was to assess the effectiveness and safety of COVID-19 vaccines through analyses of all currently available randomized clinical trials. We searched the databases CENTRAL, MEDLINE, Embase, and other sources from inception to June 17, 2021 for randomized clinical trials assessing vaccines for COVID-19. At least two independent reviewers screened studies, extracted data, and assessed risks of bias. We conducted meta-analyses, network meta-analyses, and Trial Sequential Analyses (TSA). Our primary outcomes included all-cause mortality, vaccine efficacy, and serious adverse events. We assessed the certainty of evidence with GRADE. We identified 46 trials; 35 trials randomizing 219 864 participants could be included in our analyses. Our meta-analyses showed that mRNA vaccines (efficacy, 95% [95% confidence interval (CI), 92% to 97%]; 71 514 participants; 3 trials; moderate certainty); inactivated vaccines (efficacy, 61% [95% CI, 52% to 68%]; 48 029 participants; 3 trials; moderate certainty); protein subunit vaccines (efficacy, 77% [95% CI, −5% to 95%]; 17 737 participants; 2 trials; low certainty); and viral vector vaccines (efficacy 68% [95% CI, 61% to 74%]; 71 401 participants; 5 trials; low certainty) prevented COVID-19. Viral vector vaccines decreased mortality (risk ratio, 0.25 [95% CI 0.09 to 0.67]; 67 563 participants; 3 trials, low certainty), but comparable data on inactivated, mRNA, and protein subunit vaccines were imprecise. None of the vaccines showed evidence of a difference on serious adverse events, but observational evidence suggested rare serious adverse events. All the vaccines increased the risk of non-serious adverse events. Conclusions: The evidence suggests that all the included vaccines are effective in preventing COVID-19. The mRNA vaccines seem most effective in preventing COVID-19, but viral vector vaccines seem most effective in reducing mortality. Further trials and longer follow-up are necessary to provide better insight into the safety profile of these vaccines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine
Polack, F. P., Thomas, S. J., Kitchin, N., Absalon, J., Gurtman, A., Lockhart, S., Perez, J. L., Pérez Marc, G., Moreira, E. D., Zerbini, C., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2034577 · Cited by 14,592 · cited 1×
“The included vaccines were based on mRNA [34, 41, 42, 66]; viral vectors [37, 39, 43, 45, 47, 50, 52, 67]; protein-subunit [38, 53]; or inactivated virus [47–49, 51] (Table 5).”
BackgroundEfficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine
Baden, L. R., El Sahly, H. M., Essink, B., Kotloff, K., Frey, S., Novak, R., Diemert, D., Spector, S. A., Rouphael, N., Creech, C. B., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2035389 · Cited by 10,119
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269 · cited 1×
“Our primary outcomes were allcause mortality; vaccine efficacy defined by either preventing COVID-19 symptoms plus positive polymerase chain rection (PCR) test, preventing severe COVID-19 symptoms plus positive PCR test, or preventing positive PCR test only; and serious adverse events [10].”
BackgroundThe PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003583 · Cited by 5,148
Voysey, M., Clemens, S. A. C., Madhi, S. A., Weckx, L. Y., Folegatti, P. M., Aley, P. K., Angus, B., Baillie, V. L., Barnabas, S. L., Bhorat, Q. E., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(20)32661-1 · Cited by 4,616
RNA-Based COVID-19 Vaccine BNT162b2 Selected for a Pivotal Efficacy Study
Walsh, E. E., Frenck, R., Falsey, A. R., Kitchin, N., Absalon, J., Gurtman, A., Lockhart, S., Neuzil, K., Mulligan, M. J., Bailey, R., et al. (2020) · doi:10.1101/2020.08.17.20176651 · Cited by 2,615
Folegatti, P. M., Ewer, K. J., Aley, P. K., Angus, B., Becker, S., Belij-Rammerstorfer, S., Bellamy, D., Bibi, S., Bittaye, M., Clutterbuck, E. A., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31604-4 · Cited by 2,419 · cited 5×
“A few trials compared the vaccine versus a control vaccine not active towards SARS-CoV2 (MenACWY) [37, 40, 45].”
BackgroundMethodInfluentialSafety and Efficacy of Single-Dose Ad26.COV2.S Vaccine against Covid-19
Sadoff, J., Gray, G., Vandebosch, A., Cárdenas, V., Shukarev, G., Grinsztejn, B., Goepfert, P. A., Truyers, C., Fennema, H., Spiessens, B., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2101544 · Cited by 2,397
Allotey, J., Fernandez, S., Bonet, M., Stallings, E., Yap, M., Kew, T., Zhou, D., Coomar, D., Sheikh, J., Lawson, H., et al. (2020) · BMJ · doi:10.1136/bmj.m3320 · Cited by 2,304
Thrombotic thrombocytopenia after ChAdOx1 nCov-19 vaccination
Greinacher, A., Thiele, T., Warkentin, T. E., Weisser, K., Kyrle, P. A., & Eichinger, S. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2104840 · Cited by 2,259 · cited 1×
“Our results should been seen together with observational evidence suggesting rare serious adverse events associated with the vaccines [68].”
ResultCINeMA: an approach for assessing confidence in the results of a network meta-analysis
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003082 · Cited by 1,935
Logunov, D. Y., Dolzhikova, I. V., Shcheblyakov, D. V., Tukhvatulin, A. I., Zubkova, O. V., Dzharullaeva, A. S., Kovyrshina, A. V., Lubenets, N. L., Grousova, D. M., Erokhova, A. S., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00234-8 · Cited by 1,747
Methods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685 · cited 1×
“We assessed heterogeneity through visual inspection of forest plots, using the I(2) statistic [11, 24, 25], and by estimating the between-study variance using the DerSimonian and Laird method [26, 27].”
MethodSelf-citationMulligan, M. J., Lyke, K. E., Kitchin, N., Absalon, J., Gurtman, A., Lockhart, S., Neuzil, K., Raabe, V., Bailey, R., Swanson, K. A., et al. (2020) · doi:10.1101/2020.06.30.20142570 · Cited by 1,569
Haas, E. J., Angulo, F. J., McLaughlin, J. M., Anis, E., Singer, S. R., Khan, F., Brooks, N., Smaja, M., Mircus, G., Pan, K., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00947-8 · Cited by 1,564
Safety and Immunogenicity of SARS-CoV-2 mRNA-1273 Vaccine in Older Adults
Anderson, E. J., Rouphael, N. G., Widge, A. T., Jackson, L. A., Roberts, P. C., Makhene, M., Chappell, J. D., Denison, M. R., Stevens, L. J., Pruijssers, A. J., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2028436 · Cited by 1,523 · cited 1×
“The included vaccines were based on mRNA [34, 41, 42, 66]; viral vectors [37, 39, 43, 45, 47, 50, 52, 67]; protein-subunit [38, 53]; or inactivated virus [47–49, 51] (Table 5).”
BackgroundZhang, Y., Zeng, G., Pan, H., Li, C., Hu, Y., Chu, K., Han, W., Chen, Z., Tang, R., Yin, W., et al. (2021) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30843-4 · Cited by 1,504
Zhu, F.-C., Li, Y.-H., Guan, X.-H., Hou, L.-H., Wang, W.-J., Li, J.-X., Wu, S.-P., Wang, B.-S., Wang, Z., Wang, L., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31208-3 · Cited by 1,382
Ramasamy, M. N., Minassian, A. M., Ewer, K. J., Flaxman, A. L., Folegatti, P. M., Owens, D. R., Voysey, M., Aley, P. K., Angus, B., Babbage, G., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)32466-1 · Cited by 1,324
Efficacy of the ChAdOx1 nCoV-19 Covid-19 Vaccine against the B.1.351 Variant
Madhi, S. A., Baillie, V., Cutland, C. L., Voysey, M., Koen, A. L., Fairlie, L., Padayachee, S. D., Dheda, K., Barnabas, S. L., Bhorat, Q. E., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2102214 · Cited by 1,257
Madhi, S. A., Baillie, V., Cutland, C. L., Voysey, M., Koen, A. L., Fairlie, L., Padayachee, S. D., Dheda, K., Barnabas, S. L., Bhorat, Q. E., et al. (2021) · doi:10.1101/2021.02.10.21251247 · Cited by 1,257
Zhu, F.-C., Guan, X.-H., Li, Y.-H., Huang, J.-Y., Jiang, T., Hou, L.-H., Li, J.-X., Yang, B.-F., Wang, L., Wang, W.-J., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31605-6 · Cited by 1,225 · cited 1×
“The included vaccines were based on mRNA [34, 41, 42, 66]; viral vectors [37, 39, 43, 45, 47, 50, 52, 67]; protein-subunit [38, 53]; or inactivated virus [47–49, 51] (Table 5).”
BackgroundInterim Results of a Phase 1–2a Trial of Ad26.COV2.S Covid-19 Vaccine
Sadoff, J., Le Gars, M., Shukarev, G., Heerwegh, D., Truyers, C., de Groot, A. M., Stoop, J., Tete, S., Van Damme, W., Leroux-Roels, I., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2034201 · Cited by 1,208 · cited 2×
“Ten trials were at overall low risk of bias [43, 47, 48, 67], seventeen trials were at overall some concerns [34, 36, 38, 39, 41, 42, 46, 51–53], and eight trials were at overall high risk of bias (S1 File) [37, 40, 45].”
BackgroundPhase 1–2 Trial of a SARS-CoV-2 Recombinant Spike Protein Nanoparticle Vaccine
Keech, C., Albert, G., Cho, I., Robertson, A., Reed, P., Neal, S., Plested, J. S., Zhu, M., Cloney-Clark, S., Zhou, H., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2026920 · Cited by 1,156 · cited 1×
“The included vaccines were based on mRNA [34, 41, 42, 66]; viral vectors [37, 39, 43, 45, 47, 50, 52, 67]; protein-subunit [38, 53]; or inactivated virus [47–49, 51] (Table 5).”
BackgroundSafety and Efficacy of NVX-CoV2373 Covid-19 Vaccine
Heath, P. T., Galiza, E. P., Baxter, D. N., Boffito, M., Browne, D., Burns, F., Chadwick, D. R., Clark, R., Cosgrove, C., Galloway, J., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2107659 · Cited by 1,085
A comparison of heterogeneity variance estimators in simulated random‐effects meta‐analyses
Langan, D., Higgins, J. P. T., Jackson, D., Bowden, J., Veroniki, A. A., Kontopantelis, E., Viechtbauer, W., & Simmonds, M. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1316 · Cited by 1,074 · cited 1×
“We assessed heterogeneity through visual inspection of forest plots, using the I(2) statistic [11, 24, 25], and by estimating the between-study variance using the DerSimonian and Laird method [26, 27].”
MethodSelf-citationSafety, immunogenicity, and efficacy of the BNT162b2 covid-19 vaccine in adolescents
Frenck, R. W., Klein, N. P., Kitchin, N., Gurtman, A., Absalon, J., Lockhart, S., Perez, J. L., Walter, E. B., Senders, S., Bailey, R., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2107456 · Cited by 889
Jakobsen, J. C., Wetterslev, J., Winkel, P., Lange, T., & Gluud, C. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-120 · Cited by 704 · cited 5×
“We systematically assessed the risks of systematic errors through bias risk assessments, we conducted Trial Sequential Analyses to control random errors and guide our GRADE assessments of the domain ‘imprecision’, and we adjusted our thresholds for statistical significance to control the risks of random errors [15].”
BackgroundMethodInfluentialSelf-citationNew SARS-CoV-2 Variants — Clinical, Public Health, and Vaccine Implications
Abdool Karim, S. S., & de Oliveira, T. (2021) · New England Journal of Medicine · doi:10.1056/nejmc2100362 · Cited by 699
Living systematic review: 1. Introduction-the why, what, when, and how
Elliott, J. H., Synnot, A., Turner, T., Simmonds, M., Akl, E. A., McDonald, S., Salanti, G., Meerpohl, J., MacLehose, H., Hilton, J., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.010 · Cited by 655 · cited 1×
“Our living systematic review will be continually updated to incorporate relevant new evidence as it becomes available [8, 89, 90].”
BackgroundEfficacy of NVX-CoV2373 Covid-19 Vaccine against the B.1.351 Variant
Shinde, V., Bhikha, S., Hoosain, Z., Archary, M., Bhorat, Q., Fairlie, L., Lalloo, U., Masilela, M. S. L., Moodley, D., Hanley, S., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2103055 · Cited by 625
Preliminary Efficacy of the NVX-CoV2373 Covid-19 Vaccine Against the B.1.351 Variant
Shinde, V., Bhikha, S., Hoosain, Z., Archary, M., Bhorat, Q., Fairlie, L., Lalloo, U., Masilela, M. S. L., Moodley, D., Hanley, S., et al. (2021) · doi:10.1101/2021.02.25.21252477 · Cited by 625
Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001603 · Cited by 596 · cited 1×
“Our living systematic review will be continually updated to incorporate relevant new evidence as it becomes available [8, 89, 90].”
BackgroundPapakonstantinou, T., Nikolakopoulou, A., Higgins, J. P. T., Egger, M., & Salanti, G. (2020) · Campbell Systematic Reviews · doi:10.1002/cl2.1080 · Cited by 596
Vasileiou, E., Simpson, C. R., Shi, T., Kerr, S., Agrawal, U., Akbari, A., Bedston, S., Beggs, J., Bradley, D., Chuter, A., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00677-2 · Cited by 549
Wu, Z., Hu, Y., Xu, M., Chen, Z., Yang, W., Jiang, Z., Li, M., Jin, H., Cui, G., Chen, P., et al. (2021) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30987-7 · Cited by 541
Ella, R., Vadrevu, K. M., Jogdand, H., Prasad, S., Reddy, S., Sarangi, V., Ganneru, B., Sapkal, G., Yadav, P., Abraham, P., et al. (2021) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30942-7 · Cited by 424
Cited by
Efficacy and safety of COVID-19 vaccines
Graña, C., Ghosn, L., Evrenoglou, T., Jarde, A., Minozzi, S., Bergman, H., Buckley, B. S., Probyn, K., Villanueva, G., Henschke, N., et al. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015477 · Cited by 310
How to update a living systematic review and keep it alive during a pandemic: a practical guide
Heron, L., Buitrago-Garcia, D., Ipekci, A. M., Baumann, R., Imeri, H., Salanti, G., Counotte, M. J., & Low, N. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02325-y · Cited by 26
How to update a living systematic review and keep it alive during a pandemic: a practical guide
(2023) · doi:10.21203/rs.3.rs-2364994/v1
Metadata
- Authors
- Korang, S. K., von Rohden, E., Veroniki, A. A., Ong, G., Ngalamika, O., Siddiqui, F., Juul, S., Nielsen, E. E., Feinberg, J. B., Petersen, J. J., Legart, C., Kokogho, A., Maagaard, M., Klingenberg, S., Thabane, L., Bardach, A., Ciapponi, A., Thomsen, A. R., Jakobsen, J. C., & Gluud, C.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-01-21
- Volume
- 17
- Issue
- 1
- Pages
- e0260733
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W4206924186
- Cited by
- 95
- References
- 38
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.